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The  purpose  of  this  research  effort  is  to  validate  the  utility  and  effectiveness 
of  a  unique  human  performance  measurement  technique  developed  under  ONR  contract 
(N0001467C0107).  Performance  data  on  eight  Navy  ratings  was  collected  from  ships  of 
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statistical  analysis  of  that  data.  A  statistical  analysis  is  provided  on  performance 
related  data  for  electronic  maintenance  personnel  sampled  from  21  ships.  Four  dif¬ 
ferent  performance  estimators,  as  functions  of  critical  incidents,  were  evaluated. 

A  detailed  explanation  of  the  distributional  properties  of  the  performance  estimators 
is  presented  and  an  explanation  of  the  factors  that  lead  to  the  adoption  of  a  curvi¬ 
linear  regression  analysis  for  analysis  of  the  data  is  discussed. 

The  results  of  the  statistical  analysis  indicated  that  a  certain  combination  of 
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of  the  technique  to  technicians  in  the  RM,  ST,  and  TM  ratings  was  tenuous,  but  still 
appropriate,  while  none  of  the  performance  estimators  seemed  to  be  applicable  to 
technicians  in  the  RD  rating.  For  this  reason  it  would  seem  that  the  appropriateness 
of  application  of  this  technique  to  other  ratings  warrants  investigation,  perhaps  by 
the  approach  employed  in  this  report.  In  any  event  it  has  been  observed  that  the 
technique  possesses  sufficient  merit  to  be  recommended  for  more  widespread  use  within 
the  U.  S.  Navy. 
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SUMMARY  AND  CONCLUSIONS 


Problem 


The  advent  of  a  more  streamlined  Navy  operating  under  reduced  manning  levels  and 
heightened  operational  requirements  imposes  the  need  for  accurate  human-performance 
evaluation  of  ship  personnel  systems.  On  the  personnel  systems  level,  electronic 
technician  reliability  measurement  is  a  necessary  and  integral  part  in  the  evaluation 
of  particular  combat  systems  of  which  technicians  are  components.  The  objective  is 
then  to  develop  and  evaluate  human-performance  reliability  estimates  so  as  to  be  able 
to  effectively  alter  the  personnel  system  in  order  to  maximize  the  overall  performance 
of  the  system.  The  purpose  of  this  project  is  to  validate  the  utility  and  effectiveness 
of  a  unique  human  performance  measurement  procedure  developed  under  a  prior  Office  of 
Naval  Research  project  and  designed  to  Improve  upon  existing  performance  measuring 
techniques  in  a  systems  environment. 

Background  and  Requirements 

Human  reliability  performance  estimation  can  be  accomplished  by  considering  the 
Individuals  being  evaluated  as  components  of  a  personnel  system.  This  consideration 
allows  the  use  of  much  of  the  theory  already  applied  to  equipment  reliability  estimation 
to  be  modified  to  human-performance  estimation.  After  this  theory  is  applied  to  evalu¬ 
ate  the  performance  of  human  components  in  a  personnel  system,  appropriate  combinations 
of  the  individual  performance  estimators  will  provide  a  performance  or  reliability  es¬ 
timate  of  the  personnel  system  itself. 

In  order  to  improve  upon  existing  performance  estimators  of  the  human  component  in 
a  personnel  system,  Dr.  Arthur  I.  Siegel  ahd  his  associates  of  Applied  Psychological 
Services,  Inc.,  Wayne,  Pennsylvania,  developed  fleet  post-training  performance  criteria 
for  electronic  maintenance  personnel  with  the  support  of  the  Office  of  Naval  Research. 

The  cumulation  of  these  efforts  resulted  in  the  development  of  unique  human  performance 
measurement  techniques,  closely  allied  with  equipment  reliability  estimation  techniques. 
Siegel  also  developed  procedures  for  combining  the  technician  performance  estimates  in 
appropriate  ways  in  order  to  estimate  team,  ship  or  squadron  performance. 

An  outgrowth  of  the  prior  research  effort  was  the  suggestion  that  the  techniques 
be  introduced  on  a  limited  basis  to  determine  how  they  may  be  modified  or  elaborated 
upon.  The  Naval  Personnel  Research  and  Development  Laboratory  has  been  validating  the 
utility  and  effectiveness  of  these  techniques.  The  main  technical  objectives  of  this 
validation  effort  are  to  determine  the  validity  of  the  performance  measurement  techniques, 
identify  modifications  required  to  maximize  their  possibility  for  implementation  and  to 
comment  on  the  statistical  properties  of  those  techniques  as  related  to  their  effective¬ 
ness  in  an  operational  context. 

Approach 

In  order  to  realize  an  efficient  and  timely  data  collection  effort,  optical  scanning 
instruments  were  utilized  similar  to  those  employed  by  Applied  Psychological  Services  in 
prior  research  efforts. 

The  main  data  collection  instruments  were: 

1.  Job  Performance  Questionnaire  ( JPQ)  ANSWER  SHEET  -  this  form  records 
supervisory  estimates  of  the  total  number  of  a  technician's  uncommonly 
effective  (£UE)  and  uncommonly  Ineffective  performance  (ZUI)  that  the 
supervisor  has  observed  during  a  specified  time  period. 
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2.  Technical  Proficiency  Checkout  Form  (TPCF)  -  this  form  records  the  level 

of  technical  complexity  at  which  a  man  is  able  to  perform  without  direct 

supervision. 

3.  Personnel  Identification  Information  Form  (PI I F)  -  this  form  records 

demographic  data  on  the  technician  being  evaluated. 

On  each  of  the  above  instruments  an  individual  in  one  of  the  electronic  maintenance 
ratings  EM,  ET,  FT,  IC,  RD,  RM,  ST,  and  TM  was  evaluated  by  his  supervisor.  On  the 
basis  of  the  total  number  of  uncommonly  effective  (£UE)  and  the  total  number  of  uncom¬ 
monly  ineffective  (EUI)  incidents  of  performance  recorded  on  the  Job  Performance  Ques¬ 
tionnaire  (JPQ),  three  different  performance  estimators  were  developed  previously  by 
Applied  Psychological  Services.  These  estimators  are  functions  of  the  total  number  of 
uncommonly  effective  (SUE)  and  the  total  number  of  uncommonly  ineffective  (ZUI)  incidents 
of  performance  observed  by  the  supervisor  on  each  of  eight  job  dimensions  characteristic 
of  electronic  maintenance  activities.  The  three  estimators  of  human  reliability  are: 

1.  Series  Reliability  Estimate  (SRE) 

2.  Series-Parallel  Reliability  Estimate  (PRE) 

3.  Geometric  Mean  Reliability  Estimate  (GRE) 

In  addition,  a  fourth  measure  of  technician  on-the-job  performance  developed  in  the 
course  of  this  research  effort  was: 

4.  Weighted-Average  Reliability  Estimate  (WRE). 

By  adopting  the  Technical  Proficiency  Checkout  Form  (TPCF)  as  a  criterion  measure 
of  technician  on-the-job  performance,  the  degree  of  association  between  each  of  the  four 
performance  estimators  and  criterion  measure  was  developed  for  various  locations  and 
each  rating.  Furthermore,  a  curvilinear  regression  analysis  was  applied  to  determine 
the  best  linear  relationship  between  those  variables. 

While  the  purpose  of  this  project  was  not  to  evaluate  the  criterion  measure  (TPCF), 
conditional  and  joint  frequencies  of  the  job  tasks  by  rating  revealed  the  modifications 
needed  on  the  TPCF  to  make  it  more  current.  Furthermore,  from  the  conditional  and  joint 
frequencies  it  was  possible  to  develop  a  competency  level  for  each  rating  and  permit  an 
in-depth  analysis  of  the  job  task  structure  for  those  ratings. 

Comparisons  between  ships  and  ratings  were  made  by  employing  the  WRE  since  it  was 
identified  as  a  more  promising  performance  estimator.  Initially  a  two-way  Analysis  of 
Variance  was  employed  on  the  sample  data.  However,  because  of  the  significant  inter¬ 
action  that  was  found  to  exist  between  ships  and  ratings,  comparisons  between  ships 
(ratings)  were  made  for  a  fixed  rating  (ship). 

Finally,  product-moment  correlation  coefficients  were  developed  between  various 
performance  variables  and  several  demographic  variables.  In  particular,  Basic  Test 
Battery  scores  (GCT,  ARI,  MECH,  and  CLER  scores),  usually  employed  to  predict  actual 
school  success,  were  investigated  in  order  to  determine  the  degree  of  association 
between  those  scores  and  the  measures  of  on-the-job  performance  developed  in  this 
research  effort. 

Findings 

In  order  to. determine  the  appropriateness  of  standard  statistical  techniques  or 
tests  employed  for  various  purposes  in  this  research  effort,  initial  findings  were 
concerned  with  the  results  of  an  analysis  of  the  distributional  properties  of  the  predictor 
and  criterion  variables.  From  an  application  of  appropriate  aoodness-of-f it  tests  for 
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normality  to  the  sample  data,  only  the  predictor  variable  WRE  could  be  termed  normally 
distributed.  This  result  was  also  generally  true  when  individual  ratings  were  similarly 
studied.  These  characteristics  of  the  sample  data  necessitated  the  use  of  a  curvi¬ 
linear  regression  analysis.  An  emphasis  on  only  the  least-squares  analysis  resulting 
from  an  application  of  that  technique  was  employed  in  order  to  determine  the  relative 
merits  of  each  of  the  predictor  variables. 

A  comparison  of  the  multiple  correlation  coefficients  resulting  from  the  curvi¬ 
linear  regression  analysis  applied  across  all  ratings  revealed  that  a  straight-line  was 
the  best  fit  to  the  sample  data.  The  product-moment  correlations  between  the  predictor 
variables  (SRE,  PRE,  GRE,  and  WRE)  and  the  selected  criterion  variable  suggested  moderate 
promise  on  the  part  of  the  WRE  for  appraising  the  on-the-job  performance  of  individuals 
involved  in  electronics  maintenance  activities.  However,  the  relatively  low  multiple 
correlation  coefficients  suggested  a  significant  degree  of  unexplained  criterion  variance. 
As  such  the  analysis  was  applied  by  rating.  Relevant  findings  by  rating  revealed  that 
in  almost  every  rating  the  WRE  demonstrated  more  promise  for  appraising  on-the-job 
technician  performance  than  the  other  estimators.  The  WRE  was  considered  a  more  promising 
estimator  in  the  sense  that  the  sample  product -moment  correlation  coefficients  were 
generally  of  a  larger  magnitude  and,  by  some  fit  to  the  data,  the  WRE  seemed  to  account 
for  more  criterion  variance.  For  example,  the  WRE  indicated  product-moment  correlations 
of  .492,  .445,  .430,  and  .434  for  the  EM,  ET,  FT,  and  IC  ratings,  respectively,  while 
the  next  more  promising  estimator  (GRE)  demonstrated  product-moment  correlations  of  .301, 
.508,  .374,  and  .387  for  the  EM,  ET,  FT,  and  IC  ratings,  respectively.  It  is  to  be  noted 
that  while  the  WRE  may  not  necessarily  be  a  statistically  significantly  different  estimator 
interms  of  producing  higher  correlations  with  the  criterion  variable  and  explaining  more 
criterion  variance,  the  sample  data  results  did  tend  to  demonstrate  that  the  WRE  was  the 
more  promising  estimator  in  that  consistently  the  sample  results  did  produce  higher 
product-moment  and  multiple  correlation  coefficients  for  the  WRE.  Altogether  the  WRE 
demonstrated  very  promising  results  on  the  EM,  ET,  FT,  and  IC  ratings  and  fair  results 
on  the  RM,  ST,  and  TM  ratings.  None  of  the  performance  estimators  were  at  all  promising 
in  the  RD  rating. 

Relevant  findings  from  an  analysis  of  the  Technical  Proficiency  Checkout  Form  re¬ 
vealed  that  it  was  a  very  instructive  instrument  for  determining  technician  proficiency 
in  one  job  task  in  relation  to  another.  Only  one  job  task  -  the  calibrating  of  the 
equipment  used  by  the  technicians  -  seemed  to  be  out  of  place  in  the  hierarchial  order 
of  the  job  tasks  represented  by  this  instrument. 

Findings  of  the  multiple  comparison  of  ships  and  ratings  included  the  result  that 
significant  interaction  exists  between  ship-rating  combinations.  This  resulted  in  the 
development  of  multiple  comparisons  of  ships  (ratings)  for  a  fixed  rating  (ship).  From 
this  analysis  it  was  found  that  no  pairwise  significant  difference  exists  between  ships. 

On  some  ships  a  pairwise  significant  difference  exists  between  some  ratings,  but  no  pat¬ 
tern  emerged  across  ships  as  to  which  rating(s)  demonstrated  a  higher  or  lower  mean 
performance  level. 

The  product-moment  correlation  coefficients  developed  between  the  demographic  vari¬ 
ables  and  the  performance  variables  were  of  the  same  magnitude  as  those  which  are  usually 
found  to  exist  between  predictor  variables  and  measures  of  on-the-job  performance.  Prom¬ 
ising  results  were  found  in  this  research  effort  on  the  relationship  of  demographic  vari¬ 
ables  to  on-the-job  performance. 

Conclusions 


Employing  the  TPCF  as  a  criterion  measure  of  technician  on-the-job  performance  it 
may  be  stated  that  the  following  list  represents  an  accurate  portrayal  of  the  performance 
measurement  technique  that  was  researched  : 

1.  The  distribution  of  the  predictor  variables  SRE,  PRE,  and  GRE  are 
generally  skewed  in  one  direction  or  another,  while  the  criterion 
variable  derived  from  the  TPCF  is  negatively  skewed.  The  WRE  is 
normally  distributed.  These  conclusions  are  for  each  rating  and  across 
ratings. 


v 


2.  The  WRE  is  a  more  promising  type  of  performance  estimator.  It  has 
greatest  utility  when  applied  to  technicians  in  the  EM,  ET,  FT,  and  IC 
rating  and  fair  promise  for  application  in  the  RM,  ST,  and  TM  ratings. 

3.  None  of  the  performance  estimators  is  appropriate  for  use  upon 
technicians  in  the  RD  rating. 

4.  The  Technical  Proficiency  Checkout  Form  (TPCF)  demonstrated  significant 
promise  for  appraising  the  job  task  structure  and  proficiency  of  electronics 
maintenance  personnel  without  restriction  to  a  particular  rating. 

5.  In  all  ratings  a  more  current  factor  analytic  task  analysis  would  be 
desirable  before  implementation  of  the  technique.  This  would  involve  a 
revision  of  the  job  activity  factors  on  the  JPQ  ANSWER  SHEET  and  job  task 
descriptions  on  the  TPCF  by  rating. 

6.  It  is  recommended  that  a  validation  of  the  performance  variables  (SRE, 

PRE,  GRE  and  WRE)  be  completed  before  the  technique  is  applied  to  other  than 
those  ratings  researched  in  this  report. 

In  conclusion  it  is  to  be  noted  that  the  performance  measurement  technique  that  was 
researched  is  of  significant  merit  to  be  considered  for  practical  application  in  the  U.S 
Navy  (particularly  in  the  EM,  ET,  FT,  and  IC  ratings).  At  the  present  stage  in  the  art 
of  developing  performance  measurement  techniques,  the  technique  that  was  researched  is 
probably  the  best  performance  measurement  procedure  presently  available  for  application 
within  the  U.  S.  Navy. 


vi 


REPORT  USE  AND  EVALUATION 


Feedback  from  consumers  concerning  the  utilization  of  reports  is  a  vital 
element  in  improving  products  so  that  they  better  respond  to  specific  needs.  To 
assist  the  Chief  of  Naval  Personnel  in  future  planning,  it  is  requested  that  the 
use  and  evaluation  form  on  the  reverse  of  this  page  be  completed  and  returned. 
The  page  is  preaddressed  and  franked;  fold  in  thirds,  seal  with  tape,  and  mail. 


Department  of  the  Navy 


Official  Business 


POSTAGE  AND  FEES  PAID 
DEPARTMENT  OF  THE  NAVY 
DoD-316 


Commanding  Officer 

Naval  Personnel  Research  and  Development 
Laboratory 
Building  200 
Washington  Navy  Yard 
Washington,  D.  C.  20374 


Report  Title  &  No. Analysi s  of  a  Fleet  Post-Training  Performance 
Measurement  Technique  WTR  73-47 

1.  EVALUATION  OF  REPORT.  Please  check  appropriate  column. 


A  WHAT  ARE  YOUR  MAIN  USES  FOR  THE  MATERIAL  CONTAINED  IN  THE  REPORT? 


B.  ARE  THERE  ANY  SPECIFICS  OF  THE  REPORT  THAT  YOU  FIND  ESPECIALLY  BENEFICIAL  (OR 
THE  REVERSE)  TO  YOUR  AREA  OF  RESPONSIBILITY?  IF  SO,  PLEASE  AMPLIFY 


C.  WHAT  CHANGES  WOULD  YOU  RECOMMEND  IN  REPORT  FORMAT  TO  MAKE  IT  MORE  USEFUL? 


D.  WHAT  TYPES  OF  RESEARCH  WOULD  BE  MOST  USEFUL  TO  YOU  FOR  THE  CHIEF  OF  NAVAL 
PERSONNEL  TO  CONDUCT? 


E.  DO  YOU  WISH  TO  REMAIN  ON  THE  DISTRIBUTION  LIST?  YES _ NO 


F.  PLEASE  MAKE  ANY  GENERAL  COMMENTS  YOU  FEEL  WOULD  BE  HELPFUL  IN  PLANNING  THE 
RESEARCH  PROGRAM. 


NAME: _ _ CODE: 

ORGANIZATION: _ 

ADDRESS: 


GPO  861-277 


TABLE  OF  CONTENTS 


Page 

FOREWORD .  11 

SUMMARY  AND  CONCLUSIONS .  Ill 

USE  AND  EVALUATION  FORM  (AUTHORIZED  TEAR-OUT  FORM)  . 

LIST  OF  TABLES .  xl 

LIST  OF  FIGURES .  xll 

INTRODUCTION  .  1 

BACKGROUND  .  1 

Personnel  Performance  Estimation  .  2 

Job  Performance  Questionnaire .  2 

Estimation  of  Technician  Reliability  .  3 

Validation  of  Performance  Estimators  .  4 

Technical  Proficiency  (TP)  Score .  5 

Technical  Proficiency  Checkout  (TPC)  Level . 5 

Main  Results  of  Prior  Studies .  6 

PURPOSE . .  .  .  ■ .  6 

DATA  COLLECTION .  6 

Data  Collection  Instruments .  7 

Analyses  Based  on  the  Data  Collection  Effort  .  7 

Analyses  Based  on  the  Job  Performance  Questionnaire  ....  7 

Problems  In  Calculating  Performance  Estimates .  14 

A  Convention  for  Estimating  Performance  In  Certain 

Job  Activities .  14 

Analyses  Based  on  the  Technlclal  Proficiency  Checkout  Form.  14 

APPROACH .  18 

RESULTS  AND  DISCUSSION  .  19 

Validity  of  the  Performance  Estimators .  19 

Triserial  Correlation  Analyses  .  19 

Curvilinear  Regression  Analysis .  22 

Within  Rating  Analyses  .  24 

Technician  Job  Competency  Evaluation .  29 

Job  Task  Analyses . 29 

Conditional  Frequencies  for  Job  Tasks . 32 

Joint  Frequencies  for  Job  Tasks .  33 

Multiple  Comparisons  of  Ships  and  Ratings  .  34 

Distributional  Properties  of  the  Performance  Estimators .  35 

Choice  of  a  Variable .  35 

An  Analysis  of  Variance  with  Interaction  .  36 

Testing  for  Significant  Ship  (Rating)  Effects  for  a  Particular 

Rating  (Ship) . . .  37 

Association  Between  Demographic  and  Performance  Variables  .  39 

Utility  of  Demographic  Variables  In  Performance  Prediction  ...  39 

Demographic  Variable  Prediction  on  Combined  Locations  ...  39 

Demographic  Variable  Prediction  in  the  EM,  ET,  FT,  and  IC 
Ratings .  39 


lx 


TABLE  OF  CONTENTS  (Contd) 


Page 

SUMMARY  AND  CONCLUSIONS .  42 

Summary  of  Data  Analyses .  42 

Evaluation  of  the  Performance  Estimators  .  42 

The  Criterion  Measure  of  On-the-Job  Performance .  42 

Comparisons  Between  Ships  and  Ratings .  43 

Analysis  of  Demographic  Data . 44 

Observations  on  the  Use  of  Composite  Reliability  Values  .  44 

Effect  of  the  Convention  on  the  Performance  Estimates  SRE, 

PRE,  and  GRE .  45 

The  Convention  in  the  RD  Rating .  45 

The  Convention  in  Other  than  the  RD  Rating .  46 

Observations  on  the  Use  of  Composite  Reliability  Values.  ...  46 

Conclusions .  46 

APPENDIX  A  -  Performance  Evaluation  Instruments .  A-l 

APPENDIX  B  -  Data  Collection  Procedures .  B-l 

APPENDIX  C  -  Instructions  for  Ship  Liaison  Officer . C-l 

APPENDIX  D  -  Instructions  for  Supervisor  .  D-l 

APPENDIX  E  -  Problems  in  Calculating  Reliability  Ratios .  E-l 

APPENDIX  F  -  The  Adoption  of  a  Convention  for  Each  Job  Activity  and 

Rating .  F-l 

APPENDIX  G  -  A  Few  Remarks  on  Curvilinear  Regression .  G-l 

APPENDIX  H  -  Results  of  the  Curvilinear  Regression  on  949  Technicians 

Evaluated .  H-l 

APPENDIX  I  -  Results  of  the  Curvilinear  Regression  Analysis  by  Rating.  .  1-1 

APPENDIX  J  -  Job  Task  Conditional  and  Joint  Frequencies  by  Rating.  ...  J-l 

APPENDIX  K  -  The  Utility  of  the  WRE .  K-l 

REFERENCES  . 

DISTRIBUTION  LIST . 


x 


LIST  OF  TABLES 


Page 

1.  NUMBER  OF  MEN  IN  EACH  RATING  AND  SHIP .  8 

2.  CLASS  INTERVALS  FOR  HISTOGRAMS  .  13 

3.  NUMBER  OF  MEN  AT  EACH  TECHNICAL  PROFICIENCY  CHECKOUT  (TPC)  LEVEL 

LOCATION  NO.  1 .  15 

4.  NUMBER  OF  MEN  AT  EACH  TECHNICAL  PROFICIENCY  CHECKOUT  (TPC)  LEVEL 

LOCATION  NO.  2 .  16 

5.  MEAN  RELIABILITIES .  20 

6.  TRISERIAL  CORRELATION  ANALYSES  .  21 

7.  CURVILINEAR  REGRESSION  ANALYSES  BY  LOCATION . 23 

8.  EM  CURVILINEAR  REGRESSION  ANALYSES  (N  =  97) .  25 

9.  ET  CURVILINEAR  REGRESSION  ANALYSES  (N  =  173) .  25 

10.  FT  CURVILINEAR  REGRESSION  ANALYSES  (N  =  154) .  26 

11.  IC  CURVILINEAR  REGRESSION  ANALYSES  (N  =  58) .  27 

12.  RD  CURVILINEAR  REGRESSION  ANALYSES  (N  =  139) .  27 

13.  RM,  ST,  AND  TM  CURVILINEAR  REGRESSION  ANALYSES .  28 

14.  JOB  TASK  ANALYSES . 31 

15.  EM  RATING  CONDITIONAL  FREQUENCIES  (N  =  97) .  32 

16.  EM  RATING  JOINT  FREQUENCIES  (N  =  97) .  33 

17.  g1  TEST  STATISTIC  VALUES  FOR  THE  PERFORMANCE  ESTIMATORS .  35 

18.  AN  ANALYSIS  OF  VARIANCE  FOR  21  SHIPS  AND  8  RATINGS .  36 

19.  AN  ANALYSIS  OF  VARIANCE  FOR  21  SHIPS  AND  4  RATINGS .  37 

20.  MULTIPLE  COMPARISON  OF  FOUR  RATINGS  ON  NINE  SHIPS .  38 

21.  DEMOGRAPHIC  CORRELATIONS  ON  EIGHT  RATINGS .  40 

22.  DEMOGRAPHIC  CORRELATIONS  ON  FOUR  RATINGS  .  41 

E-l  NUMBER  AND  PROPORTION  OF  TECHNICIANS  IN  PROBLEM  AREAS .  E-4 

F-l  NUMBER  AND  PROPORTION  OF  TECHNICIANS  IN  PROBLEM  AREAS  ON  A 

PARTICULAR  SHIP .  F-5 

F-2  COMPOSITE  RELIABILITY  VALUES  .  .  . .  F-6 

K-l  NUMBER  AND  PROPORTION  OF  TECHNICIANS  IN  EACH  PROBLEM  AREA .  K-4 


xi 


LIST  OF  FIGURES 

Page 

1.  Histogram  of  Series  Reliability  Estimates  (SRE) . .  .  9 

2.  Histogram  of  Series-Parallel  Reliability  Estimates  (PRE)  .  10 

3.  Histogram  of  Geometric  Mean  Reliability  Estimates  (GRE) .  11 

4.  Histogram  of  Weighted-Average  Reliability  Estimates  (WRE) .  12 

5.  Histogram  of  Technical  Proficiency  Scores  (N  =  94$) .  17 


xii 


INTRODUCTION 


Current  and  expanded  commitments  of  a  modern  sophisticated  Navy  will  require 
greater  operational  effectiveness  of  fleet  personnel  systems.  The  Navy  will  have  to 
operate  fleet  personnel  systems  at  optimal  effectiveness  levels  and  maintain  fleet 
readiness.  Together  with  these  requirements,  the  advent  of  an  all-volunteer  force  and 
smaller  ship  systems  with  reduced  manning  levels  make  the  problem  of  optimizing,  and 
evaluating,  personnel  system  effectiveness  a  complex  and  critical  problem. 

While  performance  assessment  serves  a  multitude  of  purposes,  It  has  been  seen  as 
an  especially  valuable  tool  when  applied  to  the  areas  of  optimizing  personnel  system 
performance,  providing  feedback  on  naval  school  effectiveness,  the  Interpretation  of 
man-machine  Interaction,  and  as  a  factor  In  the  optimal  assignment  of  men  to  jobs. 

It  Is  In  these  applications  that  personnel  systems  performance  measurement  will  be 
able  to  address  some  of  the  more  critical  present-day  Navy  problems.  For  example, 
many  ship  systems  are  operating  with  Increasingly  sophisticated  and  complex  equipment. 
However,  Is  It  necessarily  true  that  technicians  of  comparable  sophistication  in  train 
ing  and  mental  ability  need  to  be  employed  to  operate,  maintain,  and  repair  that  equip 
ment  In  order  that  the  ship  complete  Its  mission?  While  this  report  does  not  address 
that  specific  question,  future  research  employing  individual,  and  system,  performance 
measurement  may  reveal  that  the  Navy  could  effectively  utilize  personnel  In  those 
positions  who  may  now  be  rejected  for  some  reason  related  to  their  projected  on-the- 
job  performance  In  those  positions.  As  such  there  is  a  definite  need  for  valid  and 
reliable  Individual  system  performance  assessment. 

In  order  to  achieve  a  performance  appraisal  of  personnel  systems,  recent  research 
has  been  directed  towards  viewing  personnel  system  performance  estimation  as  analogous 
to  equipment  reliability  estimation.  This  particular  approach  views  individuals  (In 
the  system)  as  "components"  In  the  personnel  system.  This  viewpoint,  and  an  applica¬ 
tion  of  the  techniques  already  employed  in  equipment  performance  estimation,  reduces 
personnel  system  performance  estimation  to  an  evaluation  of  the  performance  of  the 
Individuals  In  the  system.  Once  the  Individual  performance  estimates  have  been  made, 
meaningful  combinations  of  these  estimates  can  provide  estimates  of  personnel  system 
performance.  As  such  the  Initial  problem  reduces  to  that  of  finding  accurate  and 
valid  measurements  of  individual  performance. 

Much  recent  research  In  the  area  of  Individual  performance  measurement  has  been 
directed  towards  examining  Individual  performance  as  a  function  of  the  extremes  of 
behavior  (critical  Incidents)  of  an  individual's  performance.  These  functions  of 
behavior  can  provide  estimates  of  Individual  performance.  By  appropriate  combina¬ 
tions  of  the  Individual  performance  estimates,  estimates  of  personnel  system  per¬ 
formance  can  be  developed.  This  report  will  address  the  validity,  application,  and 
Implications  of  a  particular  procedure  that  employs  the  critical  Incidents  technique 
to  estimate  the  performance  of  electronics  maintenance  personnel. 


BACKGROUND 


The  purpose  of  this  section  is  to  give  the  reader  a  logical  development  of  the 
performance  measurement  techniques  employed  by  Applied  Psychological  Services  and 
others.  Fundamentally  these  researchers  employed  a  critical  incidents  technique  in 
deriving  estimates  of  human  performance. 
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Generally  the  main  approach  is  to  estimate  the  performance  of  a  particular  person¬ 
nel  system  as  a  function  of  the  performance  of  individuals  that  are  a  part  of  the 
system.  This  necessarily  reduces  personnel  system  performance  estimation  to  a  discus¬ 
sion  of  estimators  of  Individual  performance  where  individuals  are  the  components  of 
the  system.  Combining  the  individual  estimates  will  provide  estimates  of  personnel 
system  performance. 

Personnel  Performance  Estimation 

Let  UE  (UI)  represent  an  uncommonly  effective  (uncommonly  Ineffective)  Incident  of 
performance  observed  by  a  rater  In  a  certain  time  period  on  some  Individual  under  ob¬ 
servation.  Furthermore,  let  ZUE  (ZUI)  represent  the  total  number  of  uncommonly  ef¬ 
fective  (uncommonly  Ineffective)  Incidents  of  performance  observed.  Using  these  func¬ 
tions  of  critical  incidents,  Whitlock  [21 ] 1  demonstrated  that  there  is  a  definite 
straight  line  or  curvilinear  relationship  between  ZUE  (or  the  ratio  ZUE/ZUI)  and  cor¬ 
responding  performance  evaluations.  Prior  results  such  as  this  provided  significant 
evidence  that  the  application  of  a  critical  incidents  technique  to  performance  eval¬ 
uation  Is  a  valid  and  useful  approach. 

Following  upon  the  results  of  Whitlock,  for  example,  Applied  Psychological  Services 
further  developed  and  applied  the  above  mentioned  techniques  to  the  post-training  per¬ 
formance  evaluation  of  Individuals  In  various  avionic  or  electronic  ratings  In  the  U.  S. 
Navy.  In  particular  Siegel  and  Pfeiffer  [18],  utilizing  estimates  of  uncommonly  ef¬ 
fective  and  uncommonly  Ineffective  performances,  showed  that  these  estimates  possess 
merit  as  useful  Indicators  of  overall  personnel  proficiency.  The  researchers  employed 
magnitude  estimates  of  the  number  of  uncommonly  effective  and  uncommonly  ineffective 
performances  relative  to  a  short  prior  period  for  avionic  personnel.  They  derived  a 
performance  Index  from  the  ratio  of  the  sum  of  uncommonly  effective  performance  (SUE) 
to  the  sum  of  uncommonly  effective  plus  the  sum  of  uncommonly  Ineffective  performance 
(ZUI),  namely  (ZUE/[ZUE  +  ZUI]).  Siegel  and  Pfeiffer  [18]  concluded  that:  (1) 
magnitude  estimates  of  uncommonly  effective  and  Ineffective  performance  yielded  useful 
data  which  could  form  the  basis  for  a  personnel  subsystem  reliability  index;  (2)  the  . 
ratio  of  the  sum  of  uncommonly  effective  to  the  sum  of  uncommonly  effective  plus  the 
sum  of  uncommonly  ineffective  performance  yields  an  index  which  discriminates  in  the 
anticipated  direction;  and,  (3)  the  obtained  avionic  personnel  subsystem  index  could 
be  utilized  for  post-training  performance  appraisal,  personnel  placement,  and  squadron 
evaluation  purposes. 

Job  Performance  Questionnaire 

Eight  job  activity  factors  descriptive  of  naval  avionic  electronic  maintenance 
jobs  were  isolated  by  Siegel  and  Schultz  [19]  and  are  shown  in  Appendix  A,  page  A-7, 
along  with  their  definitions.  These  factors  formed  the  basis  of  the  Job  Performance 
Questionnaire  (JPQ),  an  instrument  for  recording  the  frequency  of  critical  incidents 
for  each  of  the  job  activity  factors.  Siegel  and  Federman  [16]  demonstrated  the 
utility  and  practicality  of  a  Job  Performance  Questionnaire  (Appendix  A,  page  A-3) 
for  technicians  In  the  eight  electronic  maintenance  ratings  EM  (electrician's  mate), 

ET  (electronics  technician),  FT  (fire  control  technician),  IC  (Interior  communica¬ 
tions  electrician),  RD  (radarman),  RM  (radioman),  ST  (sonar  technician),  and  TM 
(torpedoman's  mate).  From  an  evaluation  of  499  technician  in  those  ratings,  the 
researchers  found  that  the  JPQ  yields  an  estimate  of  the  total  number  of  uncommonly 
effective  and  uncommonly  ineffective  Incidents  of  behavior  on  the  eight  identified 
job  activity  factors. 


^ All  numbers  enclosed  in  brackets  refer  to  corresponding  numbers  of  documents  and 
publications  listed  under  REFERENCES. 
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Specifically,  for  each  job  activity  the  reliability  ratio  (2UE/[zUE  +  SUI] )  yields 
an  estimate  of  the  probability  of  effective  performance  for  the  individual  technician 
on  the  particular  job  activity  considered.  Then  the  reliability  ratios  are  compounded 
to  provide  estimates  of  individual  effectiveness  or  reliability  of  on-the-job  perform¬ 
ance  across  the  job  activities.  It  was  reported  by  Siegel  and  Federman  [16]  that  esti¬ 
mates  of  uncommonly  effective  and  of  uncommonly  ineffective  behavior  along  all  eight 
dimensions  of  job  activities  could  be  combined  into  a  meaningful  measure  of  technician 
effectiveness.  Moreover,  they  Indicated  that  the  Individual  technician  effectiveness 
values  can  be  further  treated  to  form  effectiveness  values  for  ratings,  ships,  and 
squadrons. 

Estimation  of  Technician  Reliability 

Employing  the  reliability  ratio  concept  (EUE/[i;UE.+  ZUI]),  Siegel  and  Federman 
[16]  have  developed  the  following  three  reliability  estimates: 

1)  Series  Reliability  Estimate  (SRE) 

the  series  reliability  measure  of  total  effectiveness  for 
an  Individual  is  derived  by  multiplying  individual  job  activity 
reliability  ratios  to  yield  a  total  reliability  score,  i.e., 

Rs  =  ri  x  r2  x  ...  x  r8 
where  Rs  =  series  reliability^,  and 

r,-  =  (ZUE/[ZUE  +  EUI])  is  the  reliability  ratio  for  the 
1th  job  activity. 

It  is  to  be  noted  that  use  of  the  series  reliability  estimate 
requires  the  assumption  that  performance  reliability  on  each  job 
activity  is  independent  of  performance  reliability  on  other  job 
activities. 

2)  Series  Parallel  Reliability  Estimate  (PRE) 

Siegel  and  Federman  [16]  reported  that  "...  the  series  and 
series-parallel  reliabilities  provide  measures  of  personnel 
proficiency  relative  to  performance  on  the  entire  job  (i.e., 
all  eight  job  activities).",  (p.  46).  The  series-parallel 
estimate  of  individual  proficiency  Is  defined  as: 

Rp  =  Rs  x ( 2  -  r-j)  x  ...  x ( 2  -  rQ) 
where  Rs  and  r^(1  =  1,  ...,  8)  are  defined  in  1)  above. 


It  is  helpful  to  note  that  the  series  reliability  estimate  possesses  the  fol¬ 


lowing  properties: 

a)  for  each  of  the  1=1,  ...,  8  job  activities 
0  <  ri  <_  1 ,  and,  therefore, 


b)  0  <  R$  <  1 

c)  R$  i  smallest  r^ . 
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This  particular  estimate  tends  to  provide  a  more  optimistic 
estimate  of  Individual  performance.  However,  the  content  validity 
and  derivation  of  this  estimate  deserves  further  development. 

3)  Geometric  Mean  Reliability  Estimate  (GRE) 

Let  r*,  r*,  r*,  and  r*  be  the  four  highest  job  activity  reliability 

ratios  of  the  eight  reliability  ratios  for  a  technician  being  evaluated. 
The  geometric  mean  reliability  for  the  technician  is  defined  as: 


Rg  ■  *  1  x  *  r4* 

This  particular  estimate  is  an  estimate  of  individual  perform¬ 
ance  that  stresses  the  strong  points  of  an  Individual's  perform¬ 
ance.  However,  it  also  tends  to  Ignore  his  weak  points  and, 
therefore,  should  be  used  with  caution. 

In  addition  to  the  three  performance  estimators  (SRE,  PRE,  and  GRE)  previously  in¬ 
troduced,  this  report  will  also  discuss  an  estimate  that  weights  the  importance  of  each 
job  activity  in  determining  a  technician's  overall  performance. 

4)  Weighted  Average  Reliability  Estimate  (WRE) 

To  develop  this  estimate  let: 

NJ  =  number  of  job  activities  on  which  the  technician  actually 
worked; 

1  =  index  for  the  sum  over  the  job  activities  on  which  the 
technician  actually  worked; 

r^  =  the  reliability  ratio  for  the  1th  job  activity; 

w^  =  weight  denoting  the  Importance  of  the  ith  job  activity  in 
estimating  the  technician's  overall  performance.3 

The  Weighted-Average  Reliability  Estimate  (WRE)  of  technician 
effectiveness  Is  then  defined  as: 

NJ 

Rw  =12  r-  x  Wj/NJ 
1-1  1 

Validation  of  Performance  Estimators 

In  addition  to  performance  data  collected  on  the  JPQ,  performance  data  were  col¬ 
lected  by  Siegel  and  Federman  [16]  by  means  of  an  evaluative  Instrument  called  the 
Technical  Proficiency  Checkout  Form  (TPCF)  (Appendix  A,  page  A-5).  The  TPCF  consists 
of  eight  job  tasks  listed  In  hierarchlal  order  from  easiest  to  most  difficult.  The 
eight  tasks  meet  the  Guttman  requirements  for  scalability  (see  for  example,  Guttman 
[11]).  Siegel,  Schultz,  and  Lanterman  [20],  1964,  employed  the  scale  underlying  the 
eight  tasks  to  determine  the  cutting  points  for  placing  avionic  petty  officers,  third 
class  and  strikers  In  one  of  three  levels  of  technical  proficiency.  The  procedure  for 
placing  a  technician  In  one  of  three  levels  of  technical  proficiency  is  accomplished  by 
means  of  a  Technical  Proficiency  (TP)  score  developed  from  the  TPCF. 

3 

The  procedure  for  deriving  the  weights  is  given  in  Appendix  K. 
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Technical  Proficiency  (TP)  Score 


Define  the  function  F^i  =  1,  ....  8)  as: 

'l  if  the  technician  is  CHECKED  OUT  on  the  ith 
p  =  J  task  of  the  TPCF 

.0  if  the  technician  is  NOT  CHECKED  OUT  on  the 
ith  task  of  the  TPCF. 


The  TECHNICAL  PROFICIENCY  (TP)  score  for  a  technician  is  then  defined  as: 


TP  score  = 


Technical  Proficiency  Checkout  (TPC)  Level 

Three  TECHNICAL  PROFICIENCY  CHECKOUT  (TPC)  levels  are: 


Level  1 


above  desirable 


Level  2:  below  desirable  but  at  least  minimally  acceptable 
Level  3:  below  minimally  acceptable. 

Siegel,  Schultz,  and  Laterman  [20]  based  this  trichotomous  division  of  the  TPCF  on 
supervisor's  judgments  of  the  performance  level  required  for  achieving  the  objectives 
given  in  Appendix  A,  page  A-8. 

The  procedure  for  determining  the  TPC  level  was  reported  on  in  the  previously 
mentioned  report  and  is  given  by: 


a)  add  0.5  to  TP  score  for  an  individual.  Let  TP*  be  the 
resultant  score. 

b)  if  TP*  <  3.92,  the  TPC  level  =  3 

c)  if  3.92  <  TP*  <  5.63,  the  TPC  level  =  2 

d)  if  TP*  >  5.63,  then  TPC  level  =  1. 

Siegel  and  Fischl  [17]  correlated  technicians  TPC  levels  with  the  technicians  total 
scores  on  a  performance  test.  Employing  a  triserial  correlation  coefficient  (see,  for 
example,  Jaspen  [13])  as  an  estimate  of  the  product-moment  correlation,  they  found  a 
tri serial  correlation  of  .40.  When  corrected  for  the  lack  of  perfect  reliability  in  the 
performance  test  criterion,  the  correlation  became  .74.  On  the  basis  of  their  investi¬ 
gation  of  the  then  concurrent  validity  of  the  TPCF,  they  concluded  that  the  Technical 
Proficiency  Checkout  Form,  "...  previously  shown  to  be  reliable  and  practical,  may  now 
be  considered  to  possess  a  substantial  degree  of  validity  for  appraising  the  absolute 
proficiency  level  of  avionics  technicians  in  the  fleet.",  (p.  46).  Finally,  Siegel 
and  Federman  [16]  recorded  a  tri serial  correlation  of  .38  between  the  TPC  level  of  the 
technicians  evaluated  and  their  Series  Reliability  Estimate  (SRE),  concluding  "... 
there  is  some  basis  to  believe  that  the  JPQ  results  correlate  with  on-the-job  perform¬ 
ance.",  (p.  62). 
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Main  Results  of  Prior  Studies 


Important  conclusions  of  prior  reports  relative  to  the  merits  of  the  Series  Re¬ 
liability  Estimate  (SRE),  Series-Parallel  Reliability  Estimate  (PRE),  Geometric  Mean 
Reliability  Estimate  (GRE),  and  the  Technical  Proficiency  Checkout  Form" (YPCF)  are 
as  fol  1 ows : 

1.  Reliability  ratios  of  the  form  2UE/(£U.E  +  ZUI)  indicate 
the  probability  of  effective  performance  on  a  particular  job 
activity  for  the  technician  being  evaluated. 

2.  The  JPQ  is  an  instrument  for  providing  magnitude  estimates 
of  SUE  and  £UI  for  each  man  being  evaluated  by  his  immediate 
supervisor. 

3.  The  TPCF  possesses  a  substantial  degree  of  promise  for 
appraising  the  absolute  level  of  avionic  technician  proficiency. 

4.  There  is  some  basis  (triserial  correlation  of  .38  with  TPC 
level)  to  believe  that  the  SRE  is  a  reasonably  good  estimator  of 
on-the-job  performance. 


PURPOSE 


The  purpose  of  this  research  effort  is  to  report  on  the  data  collection  effort  and 
data  reduction  methods  and  analyses  that  have  been  performed  for  the  Office  of  Naval 
Research  (ONR)  under  the  project  entitled  Personnel  Technology:  Relating  Individual 
Performance  Effectiveness  to  Unit  and  Ship  Effectiveness  (Project  Order  Number: 

PO  2-0046  NR  150-336).  The  goal  of  this  research  project  is  to  provide  an  empirical 
basis  for  assessing  the  utility  to  the  Navy  of  a  performance  measurement  technique  de¬ 
veloped  under  a  prior  ONR  contract.  Under  that  contract  Dr.  Arthur  I.  Siegel,  Philip 
J.  Federman,  and  their  associates  of  Applied  Psychological  Services,  Inc.,  Wayne,  Pa., 
developed  fleet  post-training  performance  evaluative  measures  which  have  potential  value 
for  eventual  widespread  Implementation  within  the  U.  S.  Navy.  The  results  of  their  study 
were  contained  within  the  report  -  Development  of  Performance  Evaluative  Measures: 
Investigation  into  and  Application  o7  a  Heet  Post-training  Performance  Evaluative 
System  [1FT  An  outgrowth  of  that  effort  was  the  suggestion  that  the  technique  be  em- 
pl oyed  on  a  limited  basis  by  a  Navy  laboratory  to  identify  areas  of  modification  upon 
operational  testing.  In  response  to  that  recommendation  the  Naval  Personnel  Research 
and  Development  Laboratory  submitted  a  proposal  to  ONR  to  accomplish  that  task.  Es¬ 
sentially  the  research  effort  undertaken  by  NAVPERSRANDLAB  was  accomplished  by  repli¬ 
cating  the  efforts  of  Siegel  and  Federman  [16]. 

A  second  major  objective  of  this  research  effort  was  to  further  develop  the  per¬ 
formance  measurement  techniques  of  Siegel  and  Federman  [16].  Furthermore,  similarly 
related  performance  measurement  techniques  were  researched  with  a  view  towards  possible 
implementation  of  those  techniques  within  the  U.  S.  Navy. 


DATA  COLLECTION 


The  procedures  employed  in  data  collection  for  this  project  closely  paralleled 
those  employed  by  Siegel  and  Federman  [16],  with  some  modifications  in  the  research 
instruments.  This  procedure  was  adopted  so  that  a  similar  statistical  analysis  on  the 
same  type  of  population  would  permit  some  comparisons  to  be  made  between  the  results 
of  this  research  effort  and  the  results  obtained  by  Siegel  and  Federman  [16]. 
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Every  effort  had  been  made  to  minimize  interfering  with  normal  shipboard  duties. 
For  this  reason  the  data  collection  procedure  centered  upon  the  efforts  of  ship  liaison 
officers  conducting  the  data  collection  aboard  each  ship.  Appendix  B  contains  a  dis¬ 
cussion  on  the  procedures  for  the  data  collection  reflecting  various  aspects  of  the  ef¬ 
fort  that  resulted  in  the  orderly  and  successful  completion  of  the  task.4 

Data  Collection  Instruments 


An  example  of  the  performance  evaluation  forms  that  were  completed  by  each  super¬ 
visor  for  each  technician  evaluated  are  given  in  Appendix  A.  The  instruments  are 
optical  scanning  forms,  thus,  making  them  machine-readable  and  more  capable  of  being 
placed  In  an  operational  mode.  In  particular  the  forms  were: 

1 )  Job  Performance  Questionnaire  (JPQ)  ANSWER  SHEET 

This  form  serves  the  same  purpose  as  the  JPQ  discussed  earlier, 
l.e.,  to  record  estimates  of  the  total  number  of  uncommonly  ef¬ 
fective  ( SUE)  and  uncommonly  Ineffective  (£UI)  performances  the 
supervisor  has  observed  on  each  of  the  eight  job  activities  for 
each  man  he  is  evaluating. 

2)  Technical  Proficiency  Checkout  Fonm  (TPCF) 

This  form  Is  essentially  Identical  to  the  TPCF  used  by  Siegel 
and  Federman  [16]. 

3)  Personnel  Identification  Information  Form  (PIIF) 

This  form  was  concerned  with  the  background  data  of  the  man 
being  evaluated.  It  was  completed  in  part  by  his  supervisor 
with  the  Administrative  Officer  providing  the  remaining  Informa- 
ti  on . 

Analyses  Based  on  the  Data  Collection  Effort 


Employing  the  data  collection  Instruments  discussed  in  the  previous  section,  per¬ 
formance  data  were  collected  with  the  assistance  of  men  and  ships  of  Commander;  Cruiser- 
Destroyer  Flotilla  NINE  (located  at  San  Diego,  California)  and  men  and  ships  of  Com¬ 
mander;  Cruiser-Destroyer  Force  Atlantic  Fleet  (located  at  Newport,  Rhode  Island,  and 
Boston,  Massachusetts).5  The  participating  ships  and  type  are  shown  In  Table  1  along 
with  the  number  of  men  evaluated  by  rating  and  ship  for  each  location. 

Analyses  Based  on  the  Job  Performance  Questionnaire 

A  descriptive  analysis  of  each  of  the  performance  estimators  (SRE,  PRE,  GRE,  and 
WRE)  derived  from  the  Job  Performance  Questionnaire  (JPQ)  Is  presented  in  Figures  1,  2, 

3,  and  4  and  In  the  form  of  histograms.  Each  of  these  histograms  was  developed  on  949 
technicians  and  based  on  the  performance  estimators  which  are  continuous  over  the  range 
of  0.0  to  1.0.  Class  Intervals  are  numbered  from  1  through  21  where  a  given  class  Inter¬ 
val  Is  of  length  .05.  Class  Intervals  corresponding  to  each  of  the  numbered  intervals 
are  provided  in  Table  2. 


4 

For  the  Interested  reader  Appendices  C  and  D  contain  the  Instructions  for  the  ship 
liaison  officer  and  the  technician  supervisor,  respectively. 

henceforth  In  this  report  Location  No.  1  will  refer  to  ships  at  San  Diego,  Calif., 
and  Location  No.  2  will  refer  to  ships  at  either  Newport,  R.I.,  or  Boston,  Mass. 
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TABLE  1 


NUMBER  OF  MEN  IN  EACH  RATING  AND  SHIP 


CRUDESFLOT  NINE  (Location  No.  1) 


Ship 

Type 

EM 

ET 

FT 

IC 

RD 

RM 

ST 

TM 

TOTAL 

USS  AGERHOLM  * 

DD-826 

6 

7 

7 

4 

5 

5 

5 

3 

42 

USS  BROOKE 

DEG-T 

6 

8 

16 

3 

10 

8 

9 

1 

61 

USS  GRAY 

DE-1054 

5 

10 

5 

4 

9 

7 

9 

1 

50 

USS  HORNE 

DLG-30 

4 

12 

11 

6 

5 

5 

8 

2 

53 

USS  HULL 

DD-945 

3 

9 

8 

3 

9 

9 

8 

1 

50 

USS  JOUETT 

DLG-29 

5 

10 

12 

5 

7 

6 

9 

2' 

57 

USS  PRAIRIE 

AD-15 

6 

29 

12 

6 

0 

10 

0 

13 

76 

USS  RUPERTUS 

DD -851 

5 

11 

3 

2 

9 

9 

10 

1 

50 

USS  SHELTON 

DD-790 

4 

5 

5 

1 

5 

5 

5 

0 

30 

USS  SOUTHERLAND 

DD-743 

5 

8 

9 

5 

11 

11 

9 

2 

60 

USS  HENRY  W.  TUCKER 

DD-875 

5 

9 

0 

3 

13 

11 

11 

2 

54 

TOTAL 

54 

na 

88 

42 

83 

86 

83 

28 

582 

CRUDESLANT  (Location 

No. 

2) 

Ship 

Type 

EM 

ET 

FT 

IC 

RD 

RM 

ST 

TM 

TOTAL 

USS  BASILONE 

DD-824 

4 

4 

5 

0 

0 

5 

5 

0 

23 

USS  DEALEY 

DE-1006 

3 

6 

5 

2 

3 

4 

6 

1 

30 

USS  DEWEY 

DLG-14 

6 

6 

6 

4 

6 

5 

6 

2 

41 

USS  FISKE  (Boston) 

DD-842 

5 

4 

5 

0 

5 

5 

6 

0 

30 

USS  J.  A.  FURER 

DEG-6 

4 

5 

14 

4 

5 

8 

5 

2 

47 

USS  GARCIA  (Boston) 

DE-1040 

4 

6 

6 

2 

6 

B 

10 

2 

44 

USS  GLOVER  (Boston) 

AGDE-1. 

4 

7 

3 

0 

6 

6 

12 

1 

39 

USS  HUGH  PURVIS 

DD-709 

6 

7 

10 

0 

15 

0 

9 

2 

49 

USS  TALBOT 

DEG-4 

5 

5 

9 

2 

5 

5 

5 

0 

36 

USS  JOHN  WILLIS 

DE-1027 

2 

5 

3 

2 

5 

5 

5 

1 

28 

TOTAL 

43 

55 

66 

16 

56 

51 

69 

11 

367 

TOTAL  (BOTH  LOCATIONS) 

97 

173 

154 

58 

139 

137 

152 

39 

949 
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FREQUENCY  38  18  25  37 


21 
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Fig.  1.—  Histogram  of  Series  Reliability  Estimates  (SRE) 
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FREQUENCY  178  84  84  39  38  68  49  27  15  26  6  11  6  3  8  2  0  8  2  3  292 
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Fig.  2.—  Histogram  of  Series-Parallel  Reliability  Estimates  (PRE) 
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Fig.  3.—  Histogram  of  Geometric  Mean  Reliability  Estimates  (GRE) 
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Fig.  4.—  Histogram  of  Weighted-Average  Reliability  Estimates  (WRE) 
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TABLE  2 


CLASS  INTERVALS  FOR  HISTOGRAMS 


Class  Interval 

Number 

Lower 

Boundary 

Upper 

Boundary 

1 

0.96 

1.00 

2 

0.91 

0.96 

3 

0.86 

0.91 

4 

0.81 

0.86 

5 

0.76 

0.81 

6 

0.71 

0.76 

7 

0.66 

0.71 

8 

0.61 

0.66 

9 

0.56 

0.61 

10 

0.51 

0.56 

11 

0.46 

0.51 

12 

0.41 

0.46 

13 

0.36 

0.41 

14 

0.31 

0.36 

15 

0.26 

0.31 

16 

0.21 

0.26 

17 

0.16 

0.21 

18 

0.11 

0.16 

19 

0.06 

0.11 

20 

0.01 

0.06 

21 

0.00 

0.01 
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Further  analysis  of  results  on  the  JPQ  ANSWER  SHEET  Indicated  a  high  frequency  of 
nonresponse  In  some  job  activities  and  ratings,  the  type  of  nonresponse  that  resulted 
was  for  the  case  In  which  the  man  being  evaluated  did  not  work  at  the  particular  job 
activity  under  consideration.  Furthermore,  there  was  also  a  significantly  high  pro¬ 
portion  of  men  who,  while  they  worked  at  the  job  activity  being  considered,  received 
SUE  =  0  and  SUI  =  0  from  their  supervisors.  These  observations  required  the  con¬ 
sideration  of  two  Important  areas  relative  to  the  JPQ. 

Problems  In  Calculating  Performance  Estimates.  As  discussed  In  the  Background 
section  of  this  report,  reliability  ratios  of  the  form  (EUE/[£UE  +  ZUI])  were  derived 
for  each  man  on  each  of  eight  job  activities  and  these  ratios  were  combined  to  form 
the  SRE,  PRE,  and  GRE.  However,  the  following  two  cases  require  the  adoption  of  some 
convention  In  order  to  calculate  the  reliability  ratios: 

1)  the  technician  did  not  work  at  that  job  activity,  or 

2)  the  technician  received  SUE  =  0  and  SUI  =  0  by  the  supervisor, 

Implying  that  the  reliability  ratio  0  Is  undefined. 

STTF 

By  observing  the  frequency  with  which  such  cases  occur  across  all  21  ships  partici¬ 
pating  In  the  project,  It  Is  possible  to  determine  the  extent. to  which  any  convention 
for  estimating  performance  In  those  cases  would  effect  Individual  SRE,  PRE,  and  GRE 
values.  A  complete  discussion  of  this  effect  Is  given  In  Appendix  E.  Summarizing, 
the  above  two  cases  can  have  a  dramatic  affect  upon  the  Individual  performance  esti¬ 
mates  and  these  estimates  will  be  greatly  Influenced  by  the  convention  that  Is  adopted. 

A  Convention  for  Estimating  Performance  In  Certain  Job  Activities.  Siegel  and 
Federman  [16J  employed  "...  the  average  value  for  his  rating  on  his  ship  (p.  28),. 
on  those  job  activities  which  the  technician  did  not  work  at  or  received  EUE  =  0  and 
ZUI  *  0  by  his  supervisor.  Unfortunately  the  results  of  the  data  collection  effort  at 
Location  No.  1  (Destroyer  Flotilla  NINE)  and  at  Location  No.  2  (Cruiser-Destroyer  Force 
Atlantic  Fleet)  indicated  that  this  technique  was  not  feasible.6 

In  order  to  overcome  this  problem,  the  convention  adopted  In  this  report  was  to 
employ  a  composite  reliability  value  across  all  ships  at  a  location  for  each  job  ac¬ 
tivity  and  rating.  Appendix  F  discusses  the  procedure  for  deriving  the  composite  re¬ 
liability  values,  as  employed  In  this  report. 

Analyses  Based  on  the  Technical  Proficiency  Checkout  Form 

Table  3  represents  the  numbers  of  men  at  each  of  the  three  TPC  levels  by  rating 
and  ship  and  across  each  rating  and  ship  at  Location  No.  1.  Table  4  reflects  the  same 
Information  for  Location  No.  2.  It  will  be  remembered  that  level  1  reflects. an  "above 
desirable"  proficiency  level  while  level  3  reflects  a  "below  minimally  acceptable" 
proficiency  level. 

In  addition  to  the  TPC  levels,  TP  scores  were  developed.  A  histogram  of  the  re¬ 
sulting  TP  scores  for  the  949  technicians  evaluated  Is  presented  In  Figure  5.  Almost 
Identical  histograms  of  TP  scores  were  obtained  for  data  collected  at  the  two  locations. 
Hence,  only  one  histogram  is  presented. 


60n  every  ship  sampled  at  those  locations  there  were  ratings  for  which  in  some  job 
activities  those  two  cases  occurred  for  all  men  In  that  rating.  Appendix  F  provides  a 
detailed  account  of  this  problem  for  the  Interested  reader. 
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TABLE  3 

NUMBER  OF  MEN  AT  EACH  TECHNICAL  PROFICIENCY  CHECKOUT  (TPC)  LEVEL 

Location  No.  1 


SHIP 


RATING 

TPC 

LEVEL  1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

EACH 

RATING 

1 

4 

5 

4 

2 

1 

4 

5 

3 

2 

5 

3 

38 

EM 

2 

1 

1 

0 

1 

1 

1 

1 

2 

2 

0 

2 

12 

3 

1 

0 

1 

1 

1 

0 

0 

0 

0 

0 

0 

4 

1 

4 

6 

7 

9 

7 

8 

17 

8 

5 

8 

7 

86 

ET 

2 

2 

2 

3 

1 

2 

1 

9 

2 

0 

0 

1 

23 

3 

1 

0 

0 

2 

0 

1 

3 

1 

0 

0 

1 

9 

1 

5 

10 

3 

10 

8 

8 

6 

2 

2 

5 

0 

59 

FT 

2 

2 

5 

0 

0 

0 

3 

3 

0 

3 

0 

0 

16 

3 

0 

1 

2 

1 

0 

1 

3 

1 

0 

4 

0 

13 

1 

2 

2 

2 

5 

1 

3 

4 

2 

1 

2 

2 

26 

1C 

2 

1 

0 

1 

1 

1 

2 

1 

0 

0 

3 

0 

10 

3 

1 

1. 

1 

0 

1 

0 

1 

0 

0 

0 

1 

6 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

RO 

2 

1 

1 

1 

0 

1 

0 

0 

8 

0 

3 

0 

15 

3 

4 

g 

8 

5 

8 

7 

0 

1 

5 

7 

13 

67 

1 

1 

3 

7 

0 

0 

4 

4 

1 

5 

0 

0 

25 

RM 

2 

1 

4 

0 

0 

8 

2 

3 

5 

0 

2 

8 

33 

3 

3 

1 

0 

5 

1 

0 

3 

3 

0 

9 

3 

28 

1 

4 

7 

7 

6 

3 

6 

0 

4 

5 

5 

5 

52 

ST 

2 

1 

2 

0 

1 

2 

0 

0 

6 

0 

4 

4 

20 

3 

0 

0 

2 

1 

3 

3 

0 

0 

0 

0 

2 

11 

1 

2 

1 

0 

2 

1 

2 

4 

1 

0 

2 

2 

17 

TM 

2 

1 

0 

0 

0 

0 

0 

3 

0 

0 

0 

0 

4 

3 

0 

0 

1 

0 

0 

0 

6 

0 

0 

0 

0 

7 

EACH 

1 

22 

34 

30 

34 

21 

35 

40 

21 

20 

28 

19 

304 

SHIP 

2 

10 

15 

5 

4 

17 

9 

20 

23 

5 

12 

15 

133 

3 

10 

12 

15 

15 

14 

12 

16 

6 

5 

20 

20 

145 
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TABLE  4  • 

NUMBER  OF  MEN  AT  EACH  TECHNICAL  PROFICIENCY  CHECKOUT  (TPC)  LEVEL 

Location  No.  2 


TPC 

SHIP 

EACH 

RATING 

LEVEL 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

RAT  IMG 

1 

2 

2 

3 

4 

3 

0 

2 

5 

4 

1 

26 

EM 

2 

2 

0 

1 

1 

1 

2 

1 

1 

1 

1 

11 

3 

0 

1 

2 

0 

0 

2 

1 

0 

0 

0 

6 

1 

3 

5 

5 

3 

5 

5 

7 

7 

2 

3 

45 

ET 

2 

1 

1 

1 

0 

0 

1 

0 

0 

2 

1 

7 

3 

0 

0 

0 

1 

0 

0 

0 

0 

1 

1 

3 

1 

2 

4 

4 

4 

12 

4 

1 

7 

8 

2 

48 

FT 

2 

1 

0 

2 

1 

2 

2 

2 

3 

1 

1 

15 

3 

2 

1 

0 

0 

0 

0 

0 

0 

0 

0 

3 

1 

0 

0 

2 

0 

1 

0 

0 

0 

2 

1 

6 

1C 

2 

0 

1 

2 

0 

1 

0 

0 

0 

0 

0 

4 

3 

0 

1 

0 

0 

2 

2 

0 

0 

0 

1 

6 

1 

0 

0 

0 

0 

0 

1 

2 

0 

0 

0 

3 

RD 

2 

0 

0 

6 

4 

0 

1 

4 

6 

0 

5 

26 

3 

0 

3 

0 

1 

5 

4 

0 

9 

5 

0 

27 

1 

3 

3 

4 

1 

7 

2 

0 

0 

0 

0 

20 

RM 

2 

2 

1 

1 

4 

1 

6 

3 

0 

4 

0 

22 

3 

0 

0 

0 

0 

0 

0 

3 

0 

1 

5 

9 

1 

5 

2 

4 

3 

4 

5 

2 

9 

4 

2 

40 

ST 

2 

0 

2 

0 

2 

0 

1 

0 

0 

1 

1 

7 

3 

0 

2 

2 

1 

1 

4 

10 

0 

0 

2 

22 

1 

0 

0 

0 

0 

2 

1 

0 

1 

0 

1 

5 

TM 

2 

0 

1 

1 

0 

0 

0 

1 

1 

0 

0 

4 

3 

0 

0 

1 

0 

0 

.  1 

0 

0 

0 

0 

2 

EACH 

1 

15 

16 

22 

15 

34 

18 

14 

29 

20 

10 

193 

SHIP 

2 

fi 

6 

14 

12 

5 

13 

11 

11 

9 

9 

96 

3 

2 

8 

5  • 

3 

8 

13 

14 

9 

7 

9 

78 
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Fig.  5.— Histogram  of  Technical  Proficiency  Scores 
(N  =  949) 
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APPROACH 


An  approach  to  the  statistical  analysis  of  the  data  Involved  the  selection  of  ap¬ 
propriate  analyses  within  four  general  areas: 

1.  The  validity  of  the  performance  estimators  SRE,  PRE,  GRE,  and 
WRE  with  respect  to  a  selected  criterion  measure. 

In  order  to  determine  the  validity  of  the  four  performance  es¬ 
timators  (SRE,  PRE,  GRE,  and  WRE)  for  predicting  on-the-job  per¬ 
formance  of  the  electronics  maintenance  personnel  Involved  in  the 
research  effort,  the  results  of  the  TPCF  were  used  as  a  criterion 
measure  of  absolute  technician  proficiency.  The  belief  that  the 
TPCF  reflects  the  on-the-job  performance  of  electronics  maintenance 
personnel  must  rest  to  a  large  degree  upon  related  results  of  prior 
research  efforts.  In  particular,  from  references  that  were  cited  in 
the  section  Validation  of  Performance  Estimators. 

Initially,  In  order  to  determine  the  degree  of  association  between 
the  performance  estimators  (SRE,  PRE,  GRE,  and  WRE)  and  the  selected 
criterion  variable  (TPC  level),  trl serial  correlation  coefficients 
were  developed  by  location.  Due  to  the  extreme  skewness  of  the  dis¬ 
tribution  of  the  underlying  continuum  (represented  by  TP  score,  see 
Figure  5),  a  test  of  normality  of  TP  score  was  executed  to  determine 
the  appropriateness  of  trlserlal  correlation.  This  resulted  In  the 
choice  of  a  curvilinear  regression  analysis  as  a  better  approach  for 
validating  the  performance  estimators  by  location  and  subsequently 
by  rating  with  TP  score  as  the  continuous  criterion  measure. 

2.  An  evaluation  of  technician  job  competency  as  determined  or 
Implied  by  the  TPCF. 

The  appropriateness  of  the  job  tasks  represented  on  the  TPCF 
was  approached  by  developing  a  frequency  table  of  men  CHECKED  OUT 
and  NOT  CHECKED  OUT  by  rating  on  each  job  task.  The  agreement 
of  each  job  task  to  the  hlerarchlal  classification  of  the  tasks 
provided  some  Indication  of  the  extent  to  which  It  was  still 
applicable  to  electronic  maintenance  activities.  A  more  de¬ 
tailed  analysis  of  the  TPCF  that  Included  the  development  of 
sample  conditional  and  joint  frequency  tables  allowed  the 
development  of  a  procedure  for  determining  technician  job 
competency  within  a  rating.  Furthermore,  these  analyses  re¬ 
vealed  areas  of  suggested  modifications  of  the  TPCF  prior  to 
Its  Implementation. 

3.  Multiple  comparisons  between  ratings  or  ships  with  respect  to 
their  average  performance  levels. 

The  approach  employed  In  this  report  to  develop  comparisons 
between  ratings  and  between  ships  was  an  additive  model  suggested 
by  a  two-way  fixed  effects  analysis  of  variance  with  Interaction. 

This  required  the  selection  of  the  appropriate  variable,  from 
among  SRE,  PRE,  GRE,  WRE,  and  TP  score,  upon  which  to  base  the 
comparisons.  The  variable  selected  was  the  one  which  best  met  the 
statistical  requirements,  l.e.,  normality  of  the  variable,  homo- 
genlety  of  variances  over  the  main  effects,  and  Independence  of 
ship,  rating,  and  cell  observations. 

4.  Degree  of  association  between  various  demographic  variables 
and  the  performance  variables. 
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From  the  demographic  Information  collected  on  the  Personnel 
Identification  Information  Form  (PIIF),  product-moment  cor¬ 
relations  between  the  demographic  variables,  and  the  perform¬ 
ance  estimators  (SRE,  PRE,  GRE,  WRE,  and  TP  score)  were  developed. 

This  same  approach  was  applied  to  each  of  the  eight  job  activities 
In  order  to  determine  If  any  job  activity  related  to  a  particular 
demographic  variable. 

These  areas  are  the  most  rewarding  In  the  sense  that  they  would  provide  some  In¬ 
sight  Into  the  merits  of  the  performance  measurement  technique  being  researched  and  of 
the  Implications  for  Its  application  within  the  U.  S.  Navy. 


RESULTS  AND  DISCUSSION 


Validity  of  the  Performance  Estimators 


Triserial  Correlation  Analyses 

Initially  sample  mean  reliabilities  were  developed  for  each  of  the  four  performance 
estimators  (SRE,  PRE,  GRE,  and  WRE)  for  each  TPC  level.  The  mean  reliability  values  are 
the  average  values  of  the  performance  estimators  In  the  TPC  levels,  therefore,  the  mean 
values  would  be  expected  to  be  smaller  for  a  lower  proficiency  level.  The  results  of 
this  phase  of  the  statistical  analysis  are  presented  in  Table  5  for  technicians  at  those 
ships  sampled  at  Location  No.  1,  Location  No.  2,  and  combined  locations. 

Employing  the  results  of  Table  5,  triserial  correlation  coefficients  were  developed 
between  each  of  the  performance  estimators  (SRE,  PRE,  GRE,  and  WRE)  and  Technical  Pro¬ 
ficiency  Checkout  (TPC)  level  for  technicians  sampled  at  each  location  and  combined  lo¬ 
cations.  Table  6  presents  the  resulting  triserial  correlations. 

Comparing  the  locations,  particularly  with  respect  to  the  SRE,  PRE,  and  GRE,  only 
the  trl serial  correlation  coefficients  for  data  collected  at  Location  No.  2  agree  with 
Siegel  and  Federman's  prior  results  [16].  This  observation  required  a  consideration 
of  the  appropriateness  of  trl serial  correlation  to  the  data  collected  In  this  project. 

Application  of  the  triserial  correlation  coefficient  Involves  the  following  re¬ 
quirements: 

a)  the  segmented  variable  Is  basically  continuous  and  normally 

distributed;  and, 

b)  all  the  segments  which  together  would  form  a  whole  normal 

distribution  are  present. 

Consider  again  the  histogram  In  Figure  5.  Recall  that  the  variable,  Technical 
Proficiency  score  (TP  score),  was  segmented  Into  one  of  three  levels  of  technician 
proficiency.  This  histogram  represents  the  entire  distribution  of  the  segmented 
variable,  which  may  be  taken  as  continuous  and  Is  clearly  negatively  skewed.  A 
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TABLE  5 


MEAN  RELIABILITIES 


Location  No. 

1 

Mean 

Reliabilities 

In  Each  TPC 

Level 

TPC  LEVEL 

N 

SRE 

PRE 

GRE 

WRE 

1 

303 

.351 

.597 

.931 

.657 

2 

134 

.331 

.553 

.919 

.566 

3 

145 

.427 

.625 

.923 

.557 

Location 

No. 

2 

Mean 

Reliabilities 

In  Each  TPC 

Level 

TPC  LEVEL 

N 

SRE 

PRE 

GRE 

WRE 

1 

193 

.361 

.629 

.947 

.642 

2 

96 

.213 

.380 

.928 

.557 

3 

78 

.141 

.338 

.878 

.502 

Combined  Locations 

Mean 

Reliabilities 

In  Each  TPC 

Level 

TPC  LEVEL 

N 

SRE 

PRE 

GRE 

WRE 

1 

496 

.355 

.608 

.937 

.651 

2 

230 

.283 

.483 

.923 

.562 

3 

223 

.328 

.524 

.907 

.538 
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TABLE  6 


TRISERIAL  CORRELATION  ANALYSES 


Performance  Estimators 


N 

SRE 

PRE 

GRE 

WRE 

Location 

No.  1 

582 

-0.090* 

-0.015 

0.031 

0.256* 

Location 

No.  2 

367 

0.340* 

0.335* 

0.235* 

0.335* 

Combined 

Locations 

949 

0.061 

0.1.22* 

0.099* 

0.283* 

♦Significantly  different  from  zero  at  the  a  =  .05  level. 


goodness  of  fit  test  for  normality  [5  ]  was  applied  to  the  distribution  of  TP  scores  of 
the  949  technicians.  This  test  statistic  will  be  called  the  g-j  test  statistic.7 

When  the  g-j  test  statistic  was  applied  to  the  sample  data  of  TP  scores,  the  re¬ 
sulting  test  statistic  values  were 

g-j  =  -.5123,  Implying  z  =  6.4632. 

Therefore,  the  assumption  of  normality  for  TP  scores  must  be  rejected  for  the  sample 
data  collected  on  the  population  of  electronics  maintenance  personnel  (949  technicians 
In  the  sample). 


7The  g,  test  statistic  Is  given  by  g  =  -  )Q3 

C2X  -  X)2]3/2 

where  X  represents  an  observation,  Y  the  sample  mean,  and  N  is  the  sample  size.  If 
the  null  hypothesis  Is  that  the  underlying  distribution  Is  normal, 


then  It  has  been  shown  [5  ]  that  z  =  g-j 


(N  +  1)  (N  +  3) 


6(N  -  2) 


Is  approximately  normal  with  mean  zero  and  variance  one.  In  fact  a  test  of  the 
hypothesis  that  the  underlying  distribution  Is  normal  (at  the  er  =  .05  level  of  signfi- 
cance)  Is  given  by: 


reject  the  null  hypothesis  of  normality  if 
z  Is  greater  than  1.96  or  less  than  -1.96. 

This  particular  goodness  of  fit  test  has  several  advantages  over  the  usually  ap¬ 
plied  Kolmogorov-Smlrnov  tests  or  the  well  known  Chi-square  tests  In  that,  in  particular, 
the  population  mean  and  standard  deviation  need  not  be  known  and  the  test  need  not  be 
applied  just  to  large  samples.  Furthermore,  this  test  Is  more  sensitive  to  departures 
from  normality  due  solely  to  skewness  than  the  other  two  tests  [5  ]. 
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The  g,  test  statistic  was  also  applied  to  the  distribution  of  TP  scores  at  either 
location.  The  test  statistic  values  were  g-j  =  -.4930,  z  =  -4.8810  and  g-|  =  -.5473, 
z  =  -4.3156  at  Location  No.  1  and  Location  No.  2  respectively.  Therefore,  at  both 
locations  the  assumption  of  normality  of  TP  scores  must  be  rejected.  These  results 
were  verified  by  the  histograms  of  TP  scores  for  those  locations.  In  both  cases  these 
histograms  demonstrated  the  negative  skewness  of  the  distribution  of  TP  scores. 

Curvilinear  Regression  Analysis 

Essentially  due  to  the  non-normality  of  the  TP  scores,  an  alternate  analysis  was 
employed  In  order  to  determine  the  degree  of  association  between  the  predictor  vari¬ 
ables  (SRE,  PRE,  6RE,  and  WRE)  and  criterion  variable  (TP  score).  The  particular  pro¬ 
cedure  to  be  employed  to  achieve  this  end  was  a  curvilinear  multiple  regression  pro¬ 
cedure  outlined  In  Cooley  and  Lohnes  [3],  A  few  remarks  on  this  subject  for  the 
purposes  of  this  report  have  been  provided  In  Appendix  G. 

Appendix  H  provides  the  results  of  the  analyses  of  these  predictor  and  criterion 
variables  for  the  total  of  949  technicians  sampled.  Similar  results  as  found  in  Ap¬ 
pendix  H  were  also  developed  for  Location  No.  1  and  Location  No.  2.  Although  those 
printouts  are  not  presented  In  this  report,  the  essential  Information  from  those 
printouts  Is  given  In  Table  78  along  with  the  essential  Information  from  Appendix  H. 

Consider  Table  7  and  the  evaluation  of  SRE  as  a  predictor  of  TP  score  for  the  two 
locations  combined.  The  product-moment  correlation  between  SRE  and  TP  score  is  .055 
(not  significantly  different  from  zero  at  the  a  =  .05  level).  In  attempting  to  fit  a 
linear,  quadractlc,  and  cubic  model  to  the  data  of  SRE  values  and  TP  scores,  the 
multiple  correlation  coefficient  (R2)  values  were  .003,  .007,  and  .043  respectively. 
However,  in  view  of  the  fact  that  the  residual  mean  square  does  not  change  from  the 
linear  to  cubic  model,  it  would  be  just  as  well  to  chose  the  linear  model  (particularly 
since  R2  for  the  cubic  equation  Is  not  significantly  larger  than  .007).  Therefore, 
from  Appendix  H,  the  best  regression  equation  Is 

TP  score  =  5.219  +  0.397  SRE. 

Because  SRE  and  TP  score  are  essentially  Independent,  the  best  estimate  of  SRE  will 
always  be  the  mean  of  the  observed  TP  scores,  regardless  of  the  observed  SRE.  This 
result  Is  further  reflected  In  noticing  that  the  sample  mean  TP  score  Is  5.350,  ap¬ 
proximately  equal  to  5.219  -  the  TP  score  intercept  of  the  regression  line. 

Observing  the  results  of  Table  7  for  the  predictor  variables  PRE  and  GRE  on  the 
two  locations  combined,  only  minimal  Improvement  can  be  made  with  these  estimates  over 
the  SRE.  In  fact  the  GRE  Is  almost  Identical  to  the  SRE  and  for  practical  purposes 
cannot.be  held  to  possess  significant  merit.  The  PRE  Is  modestly  better  with  a  cor¬ 
relation  of  .1.  However,  for  the  PRE,  the  highest  R2  value  does  not  even  reach  .05, 
a  long  way  from  a  perfect  fit  with  an  R2  value  of  1.0.  Based  upon  this  analysis,  PRE 
must  be  termed  only  slightly  better  than  the  SRE  and  GRE. 

The  WRE  provides  the  most  promising  and  consistent  (over  locations)  estimator  of 
the  four  predictors  considered.  It  Is  most  promising  In  the  sense  that  It  provides 


Q 

All  of  the  computer  printouts  on  the  curvilinear  regression  procedure  employed 
In  this  report  are  In  terms  of  "centered  data."  This  technique  Improves  the  computation 
of  the  printout  values  by  minimizing  roundoff  errors.  Therefore,  when  reviewing  the 
results  of  Table  7,  one  must  be  concerned  with  the  relative  magnitude  of  the  residual 
mean  square  in  attempting  to  fit  a  linear  model  versus  fitting  a  higher  order  model. 
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TABLE  7 


CURVILINEAR  REGRESSION  ANALYSES  BY  LOCATIONt 


Location  No.  1 
_ Type  of  Curve 


Predictor 

Linear 

Quadratic 

Cubic 

Variable 

r 

xy 

R2 

s2 

R2 

S2 

R2 

s2 

SRE 

-.069 

.005 

.002 

.007. 

.002 

.072 

.002 

PRE 

-.009 

.000 

.002 

.043 

.002 

.047 

.002 

GRE 

.024 

.001 

.002 

.003 

.002 

.004 

.002 

WRE 

.242* 

.058 

.002 

.058 

.002 

.062 

.002 

Location 

No.  2 

Type  of  Curve 

Predictor 

Linear 

Quadratic 

Cubic 

Variable 

rxy 

R2 

s2 

R2 

2 

s 

R2 

s2 

SRE 

.288* 

.083 

.003 

.083 

.003 

.090 

.003 

PRE 

.277* 

.077 

.003 

.078 

.003 

.100 

.002 

GRE 

.212* 

.045 

.003 

.047 

.003 

.052 

.003 

WRE 

.292* 

.085 

.003 

.085 

.003 

.089 

.003 

Locations  Combined 

Type  of  Curve 

Predictor 

Linear 

Quadratic 

Cubic 

Variable 

r 

xy 

R2 

s2 

R2 

2 

s 

R2 

2 

s  • 

SRE 

.055 

.003 

.001 

.007 

.001 

.043 

.001 

PRE 

.100* 

.010 

.001 

.036 

.001 

.036 

.001 

GRE 

.087* 

.008 

.001 

.008 

.001 

.009 

.001 

WRE 

.257* 

.066 

.001 

.066 

.001 

.071 

.001 

tR2  =  r2y 

In  the  linear 

case. 

♦Significantly  different  from  zero  at  the  a  =  .05  level. 

rXy  =  product-moment  correlation  coefficient  between  the  predictor 
variable  x  and  the  criterion  variable  y  (TP  score). 

R2  =  multiple  correlation  coefficient. 

s2  =  residual  mean  square 
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the  highest  product-moment  correlation  coefficient  with  the  selected  criterion  variable, 
TP  score.  However,  it  cannot  be  said  that  it  better  fits  the  data  than  any  of  the  other 
three  estimators  with  respect  to  the  three  types  of  curves  considered. 

The  curvilinear  regression  for  the  predictor  variable  WRE,  Appendix  H,  page  H-6, 
indicates  that  a  linear  curve  is  the  best  fit  to  the  data.  The  regression  equation  is 
given  by 


TP  score  =  3.571  +  2.95  WRE. 

In  comparison  to  the  other  estimators  the  WRE  can  be  said  to  possess  moderate  validity 
at  best  for  appraising  an  absolute  level  of  technician  performance.  As  such  its  ap¬ 
plication  to  the  population  of  electronics  maintenance  personnel  is  tenuous. 

Analyzing  the  results  at  either  location  again  points  out  the  differences  between 
the  results  obtained  at  either  location.  However,  this  is  due  mainly  to  a  difference 
In  rxy  values  and  not  to  R2  values  for  goodness  of  fit  of  the  linear,  quadratic,  and 
cubicy models  from  one  location  to  the  next.  This  may  be  due  to  the  high  degree  of  un¬ 
explained  criterion  variance  in  the  data  at  either  location  and  with  respect  to  the 
locations  combined.  Scatterplots  of  the  data  in  those  three  cases  with  respect  to 
each  predictor  variable  verified  the  high  degree  of  dispersion  in  the  data  and  the  lack 
of  any  obvious  pattern  or  functional  relationship  in  those  plots. 

Within  Rating  Analyses 

A  factor  that  may  influence  the  frequency  with  which  a  population  does  not  work 
at  a  particular  job  activity  is,  of  course,  the  appropriateness  of  the  job  activity  to 
present-day  electronic  maintenance  activities.  The  most  homogeneous  type  of  sub- 
population  that  would  reflect  most  members  of  the  subpopulation  working  at  the  same 
job  activities  should  be  rating.  It  is  mainly  for  this  reason  that  the  subpopulations 
considered  in  this  report  are  ratings,  and  not,  for  example,  ships  within  locations 
which  should  (and  did)  reflect  results  similar  to  those  found  in  Appendix  H.  In  order 
to  perform  the  most  general  type  of  analysis  to  determine  the  validity  of  the  perform¬ 
ance  estimates,  a  curvilinear  regression  analysis  as  previously  discussed  and  employed 
in  Appendix  H  was  applied  per  rating  for  each  of  the  four  predictor  variables  -  SRE, 

PRE,  GRE,  and  WRE.  Appendix  I  gives  the  resulting  32  printouts  of  the  Cooley  and 
Lohnes  [3]  curvilinear  regression  analysis.  The  object  is  to  select  for  each  rating, 
the  best  of  three  possible  curves  -  linear,  quadratic,  and  cubic  -  for  each  performance 
estimator  which  best  fits  the  data  in  terms  of  significantly  larger  multiple  correlation 
coefficients  for  smaller  residual  mean  squares.  Comparisons  between  the  performance 
estimators  may  then  be  made  by  performing  an  appropriate  test  of  hypothesis  of  the  equality 
of  two  correlation  coefficients  (or  multiple  correlation  coefficients).  The  test  that 
is  usually  applied  is  the  "Fisher's  z"  test  which  employes  the  asymptotic  distribution  of 
the  sample  correlation  coefficient.  However  this  test  requires  that  the  distributions 
of  the  underlying  populations  are  bivariate  normal  (see  Anderson  [1],  page  78).  Because 
the  distribution  of  TP  scores  and  the  SRE,  PRE,  and  GRE  were  not  normally  distributed 
with  respect  to  the  Individual  ratings,  the  appropriateness  of  employing  this  test  is 
in  question.  Furthermore  the  literature  seems  to  be  vacant  of  a  discussion  of  the 
robustness  of  the  test.  Therefore  the  approach  must  be  in  terms  of  comparing  the  observed 
sample  product-moment  correlations,  and,  in  particular,  on  the  amount  of  criterion 
variance  explained  by  the  variables.  This  approach  will  not  necessarily  produce  a 
statistically  significantly  different  performance  estimator  but  one  which  is  a  more 
promising  estimator,  in  terms  of  the  sample  information. 

The  following  outline  represents  the  essential  results  of  the  curvilinear  regres¬ 
sion  analyses  presented  in  Appendix  I.  The  results  are  presented  by  rating  in  Tables 
8  through  13  together  with  observations  and  recommendations. 
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TABLE  8 


EM  CURVILINEAR  REGRESSION  ANALYSES  (N  =  97) 


Type  of  Curve 


Predictor 

Linear 

Quadratic 

Cubic 

Variable 

rxy 

R2 

s2 

R2 

s2 

R2 

s2 

SRE 

.365* 

.133 

.009 

.136 

.009 

.176 

.009 

PRE 

.247* 

.061 

.010 

.133 

.009 

.113 

.009 

GRE 

.301* 

.090 

.010 

.154 

.009 

.221 

.008 

WRE 

.492* 

.242 

.008 

.254 

.008 

.300 

.008 

i  Significantly  different 

from 

zero  at 

the  a  = 

.05  level , 

1.  EM  rating  -  Clearly  the  estimator  WRE  demonstrates  the  best  fit 
to  the  data.  The  product-moment  correlation  of  .492  indicates  at 
least  a  fair  degree  of  association  of  the  WRE  with  the  technician's 
absolute  performance  level.  (Although  the  R2  value  is  significantly 
better  for  the  cubic  curve  over  the  other  two  curves,  the  value  of 
.300  in  that  case  can  only  indicate  a  moderate  fit  of  the  cubic  curve 
to  the  data. 

TP  score  =  4.849  -  15.571  WRE  +  44.319  WRE2  -  26.561  WRE3. 

The  other  estimators  do  not  demonstrate  a  better  fit  to  the  data 
than  the  WRE.  In  view  of  this  and  other  considerations  (e.g.,  the 
examination  of  the  scatterplots) ,  the  WRE  is  recommended  for  applica¬ 
tion  in  this  rating  for  those  situations  in  which  the  probability  of 
effective  performance  of  an  individual  in  the  EM  rating  is  required. 


TABLE  9 

ET  CURVILINEAR  REGRESSION  ANALYSES  (N  =  173) 


Type  of  Curve 


Predictor 

Linear 

Quadratic 

Cubic 

Variable 

R2 

2 

n2 

2 

_2 

2 

xy 

s 

R 

s 

R 

s 

SRE 

.318* 

.101 

.005 

.142 

.005 

.142 

.005 

PRE 

.366* 

.134 

.005 

.135 

.005 

.135 

.005 

GRE 

.508* 

.258 

.004 

.266 

.004 

.271 

.004 

WRE 

.445* 

.198 

.005 

.209 

.005 

.210 

.005 

♦Significantly  different  from  zero  at  the  a  =  .05  level. 
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2.  ET  rating  -  For  this  rating  two  significant  estimators  arise,  the 
GRE  and  Wkfe .  The  WRE  Is  still  a  promising  estimator  even  though  It 
has  a  lower  product-moment  correlation  than  the  GRE  (.445  versus  .508) 
and  does  not  fit  the  data  as  well.  The  GRE  values  may  be  spurious 
observations  for  this  rating  for  It  Is  not  significantly  higher  In 
any  other  rating.  However,  without  evidence  of  this  fact  It  is  recom¬ 
mended  that  either  the  GRE  or  WRE  be  employed  In  this  rating.  Further¬ 
more,  the  values  of  the  product-moment  correlations  for  those  esti¬ 
mators  reflect  at  least  a  moderate  degree  of  association  with  TPCF 
results. 

Because  the  R2  values  do  not  change  appreciably  from  one  type  of 
curve  to  the  next,  It  Is  recommended  that  the  linear  model  be  em¬ 
ployed  for  prediction  purposes  In  either  case.  The  linear  curves 
are: 

TP  score  =  2.99  +  4.08  GRE,  and 
TP  score  =  4.344  +  3.79  WRE. 


TABLE  10 

FT  CURVILINEAR  REGRESSION  ANALYSES  (N  =  154) 


Type  of  Curve 


Predictor 

Linear 

Quadratic 

Cubic 

Variable 

rxy 

RZ 

s 

R2 

I 

s 

R2 

1 

s 

SRE 

.346* 

.119 

.006 

.120 

.006 

.120 

.006 

PRE 

.265* 

.070 

.006 

.100 

.006 

.104 

.006 

GRE 

.374* 

.140 

.006 

.148 

.006 

.165 

.006 

WRE 

.430* 

.185 

.005 

.200 

.005 

.204 

.005 

♦Significantly  different  from  zero  at  the  a  =  .05  level. 


3.  FT  rating  -  This  rating  again  illustrates  that  the  WRE  Is  the 
most  promising  estimator.  In  fact  It  is  almost  Identical  to  the 
results  obtained  for  the  ET  rating  and  the  WRE.  The  product-moment 
correlation  of  .43  reflects  a  moderate  degree  of  association  with 
the  criterion  variable.  The  R^  value  of  near  .2  still  illustrates 
a  significant  degree  of  unexplained  criterion  variance  In  the  data. 

It  Is  again  suggested  that  the  linear  model: 

TP  score  =  3.366  +  4.635  WRE 

p 

be  employed  In  this  rating.  The  linear  model  fit  is  modest  (R  =  .185) 
but  the  WRE  possesses  sufficient  promise  to  be  called  a  good  esti¬ 
mator  of  FT  technician  proficiency. 
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TABLE  11 

IC  CURVILINEAR  REGRESSION  ANALYSES  (N  =  58) 


Type  of  Curve 


Predictor 

Linear 

Quadratic 

Cubic 

Variable 

r 

xy 

R2 

Z 

s 

R2 

s2 

R2 

s2 

SRE 

.361* 

.131 

.016 

.131 

.016 

.133 

.016 

PRE 

.322* 

.104 

.016 

.131 

.016 

.134 

.016 

GRE 

.387* 

.149 

.015 

.154 

.015 

.169 

.015 

WRE 

.434* 

.188 

.014 

.241 

.014 

.292 

.013 

♦Significantly  different  from  zero  at  the  a  =  .05  level. 


4.  IC  rating  -  Unfortunately  the  sample  size  (N  =  58)  for  this  rating 
Is  too  low  to  place  confidence  in  the  obtained  correlation  coefficient. 
However,  the  WRE  must  be  selected  as  the  most  valid  estimator  on  all 
counts.  The  cubic  model 

TP  score  =  -7.57  +  68.26  WRE  -  113.95  WRE2  +  63.03  WRE3 

Is  suggested  for  use  In  this  rating  and  is  a  moderate  estimate  of  TP 
score.  The  residual  mean  square  Is  high  for  this  rating  only  because 
of  the  small  sample  size.  In  any  event  this  rating  reflects  the 
general  trend  that  we  have  been  witnessing  and,  therefore,  the  WRE 
may  be  employed  In  this  rating. 


TABLE  12 

RD  CURVILINEAR  REGRESSION  ANALYSES  (N  =  139) 


Type  of  Curve 


Predictor 

Linear 

Quadratic 

Cubic 

Variable 

r 

xy 

R2 

s2 

R2 

s2 

R2 

s2 

SRE 

-.168 

.028 

.007 

.093 

.007 

.131 

.006 

PRE 

-.215* 

.046 

.007 

.046 

.007 

.093 

.007 

GRE 

.021 

.000 

.007 

.013 

.007 

.047 

.007 

WRE 

-.051 

.003 

.007 

.021 

.007 

.041 

.007 

♦Significantly  different  from  zero  at  the  a  =  .05  level. 
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5.  RD  rating  -  None  of  the  four  estimators  that  have  been  dls- 
cussed  In  this  report  should  be  employed  In  the  RD  rating.  In 
part  the  failure  of  the  estimators  In  this  case  must  be  attributed 
to  the  significantly  high  frequency  with  which  Individuals  In 
this  rating  do  not  work  at  the  job  activities  that  were  used  on 
the  evaluation  forms. 


TABLE  13 

RM,  ST,  AND  TM  CURVILINEAR  REGRESSION  ANALYSES 


Type  of  Curve 


Predictor 

Linear 

Quadratic 

Cubic 

Variable 

rxy 

R2 

s2 

R2 

s2 

R2 

s2 

RM  Rating 

(N  =  137) 

SRE 

.211* 

.044 

.007 

.057 

.007 

.068 

.007 

PRE 

.156 

.024 

.007 

.028 

.007 

.031 

.007 

GRE 

.041 

.002 

.007 

.140 

.006 

.139 

.006 

WRE 

.366* 

.134 

.006 

.153 

.006 

.154 

.006 

ST  Rating 

(N  =  152) 

SRE 

.199* 

.040 

.006 

.069 

.006 

.069 

.006 

PRE 

.058 

.003 

.007 

.003 

.007 

.102 

.006 

GRE 

.099 

.010 

.007 

.134 

.006 

.178 

.006 

WRE 

.234* 

.055 

.006 

.080 

.006 

.123 

.006 

TM  Rating 

(N  =  39) 

SRE 

.198 

.039 

.026 

.129 

.024 

.217 

.022 

PRE 

.243 

.059 

.025 

.094 

.025 

.153 

.024 

GRE 

.186 

.035 

.026 

.035 

.027 

.085 

.026 

WRE 

.403* 

.162 

.023 

.177 

.023 

.224 

.022 

♦Significantly  different  from  zero  at  the  a  =  .05  level. 
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6.  Rating  RM,  ST,  and  TM  -  The  results  for  these  ratings  are  almost 
Identical  and  can  be  discussed  as  a  group.  In  every  case  the  WRE 
Is  the  best  estimator  of  TP  score.  The  product-moment  correlations 
are  low  for  the  RM  and  ST  ratings,  and  moderate  for  TM's.  All  of  the 
R2  values  demonstrate  a  poor  fit  to  the  data,  Indicating  an  even 
higher  degree  of  unexplained  criterion  variance  than  that  found  In 
the  EM,  ET,  FT,  and  IC  ratings.  It  Is  recommended  that  the  cubic 
curve  be  employed  In  the  ST  and  TM  rating  and  a  linear  curve  for 
the  RM  rating.  The  corresponding  equations  may  be  found  from  the 
computer  printout  of  the  curvilinear  regression  for  those  ratings 
(pages  1-26,  1-30,  and  1-34  respectively).  However,  the  utility 
of  their  use  as  prediction  Instruments  has  not  been  convincingly 
demonstrated. 


Technician  Job  Competency  Evaluation 


As  hypothesized  In  the  discussion  on  the  validity  of  the  performance  estimators 
SRE,  PRE,  GRE,  and  WRE,  the  TPCF  could  be  employed  as  a  criterion  measure  of  the  ab¬ 
solute  proficiency  level  of  electronics  maintenance  personnel.  That  the  TPCF  pos¬ 
sesses  that  characteristic  was  evaluated  by  Siegel  and  Flschl  [17]  for  avionics 
technicians  and  at  that  time  the  TPCF  possessed  a  substantial  degree  of  promise. 

Siegel  and  Federman  [16]  applied  the  TPCF  when  appraising  the  proficiency  level  of 
electronics  maintenance  personnel  and  In  evaluating  the  SRE,  PRE,  and  GRE. 

Due  to  the  high  degree  of  reliance  on  the  TPCF  as  a  criterion  measure,  it  is  well 
to  Investigate  the  TPCF  and  consider  whether  some  of  Its  properties  seem  to  hold  up  for 
the  data  collected  In  this  project.  The  appropriateness  of  the  job  tasks  on  the  TPCF 
for  present-day  electronic  maintenance  activities  can  be  considered,  by  rating.  Further¬ 
more,  are  the  job  tasks  listed  In  the  same  hlerarchlal  order  as  when  originally  developed? 
While  It  may  not  be  possible  to  completely  answer  questions  of  this  type.  It  Is  possible 
to  give  at  least  a  partial  answer  based  on  the  present  format  of  the  TPCF.  By  using 
the  properties  of  the  TPCF  It  Is  possible  to  develop  a  competency  level  for  technicians 
In  each  rating  and  determine  whether  a  particular  rating  may  be  performing  at  a  certain 
proficiency  level. 

Job  Task  Analyses 

The  reader  will  recall  that  the  job  tasks  listed  on  the  TPCF  are  ordered  with  Job 
Task  No.  1  being  the  easiest  and  Job  Task  No.  8  the  most  difficult.  The  following  is 
a  list  of  the  job  tasks  as  found  on  the  TPCF: 


(easiest) 


1.  Capable 

2.  Capable 

3.  Capable 

4.  Capable 

5.  Capable 
related 


Task  Description 

of  employing  safety  precautions. 

of  replacing  most  of  unit's  equipment. 

of  removing  most  of  unit's  equipment. 

of  following  block  diagrams. 

of  knowing  relationship  of  equipment  to  other 
equipment. 
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6.  Capable  of  calibrating  most  of  unit's  equipment. 

7.  Capable  of  trouble-shooting/isolated  malfunctlon(s) . 

(most  8.  Capable  of  employing  electronic  principles  Involved  In 

difficult)  maintenance. 

Table  14  Is  the  frequency  of  occurrence  of  men  CHECKED  OUT  and  NOT  CHECKED  OUT  by 
rating  over  the  eight  job  tasks  without  reference  to  their  performance  on  other  job  tasks. 
For  example,  of  the  97  men  In  the  EM  rating,  95  were  CHECKED  OUT  on  Job  Task  No.  1,  87 
were  CHECKED  OUT  on  Job  Task  No.  2,  ....  and  55  were  CHECKED  OUT  on  Job  Task  No.  8. 
Similarly,  for  the  other  ratings. 

From  Table  14  the  hlerarchlal  difficulty  of  tasks  Is  generally  represented  In  the 
EM,  ET,  FT,  IC,  ST,  and  TM  ratings.  This  Is  evidenced  by  the  fact  that  one  would  expect 
progressively  fewer  men  to  complete  a  more  difficult  task.  Except  for  the  ST  rating, 

Job  Task  No.  6  -  Capable  of  calibrating  most  of  this  unit's  equipment  with  which  his 
rating  Is  concerned  -  seems  out  of1  place  in  that  fewer  Individuals  are  CHECk^b  OUT  on 
this  task  than  the  next  more  difficult  task,  Job  Task  No.  7.  In  fact  the  better  position 
for  Job  Task  No.  6  would  be  after  Job  Task  No.  8.  In  that  case  the  job  tasks  would  fol¬ 
low  more  closely  a  hlerarchlal  classification. 9 

In  any  event  It  can  be  said  that  Job  Task  No.  6  Is  no  longer  of  such  prominence  as 
originally  thought.  This  Is  a  result  of  the  Introduction  of  more  sophisticated  elec¬ 
tronic  equipment  aboard  ships  In  recent  years.  This  equipment  frequently  consists  of 
Integrated  circuitry  and  compact  electronic  modules  requiring  little  If  any  calibration. 
Furthermore,  test  Instrumentation  calibration  Is  also  In  demise  because  less  test  equip¬ 
ment  Is  being  employed.  Normally  a  defective  component  Is  replaced  en  toto  without 
regard  aboard  ship  for  finding  the  particular  fault  In  the  component.  Those  functions, 
are  beyond  normal  shipboard  electronic  maintenance  activities. 

In  the  RD  rating  there  are  a  significant  number  of  Individuals  NOT  CHECKED  OUT  on 
many  of  the  tasks.  This  Is  probably  due  more  to  a  nonappllcablllty  of  those  tasks  to 
that  rating  than  to  a  lack  of  sufficient  training.  This  Is  to  a  degree  verified  by  the 
findings  in  Appendix  E  where  It  was  demonstrated  that  for  most  job  activities  there  are 
a  very  high  proportion  of  Individuals  In  that  rating  who  either  do  not  work  at  the  job 
activities  or  received  HUE  =  0  and  EUI  =  0  from  their  supervisor.  It  Is  possible  that 
the  nonappllcablllty  of  many  of  the  tasks  to  the  RD  rating  did  give  erroneous  TP  scores 
for  this  rating  and  depressed  the  validity  coefficients  (see  Table  12).  A  more  detailed 
study  than  the  present  one  would  be  required  to  come  to  a  definite  conclusion  on  this 
Issue. 

As  shown  In  Table  14  and  the  RM  rating,  Job  Tasks  2  and  4  are  not  in  agreement  with 
the  underlying  order  of  job  tasks,  but  Job  Task  No.  6  Is  In  a  proper  position  for  this 
rating.  It  seems  that  a  reordering  of  the  first  five  job  tasks  on  the  TPCF  would  allow 
this  Instrument  to  be  more  applicable  to  this  rating.  It  would  probably  require  a 
minor  research  effort  to  revise  the  tasks  In  the  RM  rating. 


Q 

It  is  Important  to  note  that  none  of  the  conclusions  of  previous  sections  would  be 
altered  with  this  modification  because  the  TP  score  (or  TPC  level)  Is  Independent  of  the 
hlerarchlal  classification.  Those  variables  are  dependent  only  upon  the  number  of  job 
tasks  an  Individual  was  CHECKED  OUT  on,  and  not  upon  the  order  of  the  CHECKED  OUT  tasks. 


30 


TABLE  14 


JOB  TASK  ANALYSES 


EM  Frequencies 

(N  - 

97) 

Job  Task  No. 

1 

2 

3 

4 

5 

6 

7 

8 

Checked  Out 

95 

87 

87 

77 

75 

43 

63 

55 

Not  Checked  Out* 

2 

10 

10 

20 

22 

54 

34 

42 

ET  Frequencies 

(N  • 

173) 

Job  Task  No. 

1 

2 

3 

4 

5 

6 

7 

8 

Checked  Out 

168 

147 

164 

165 

12(5 

96 

129 

132 

Not  Checked  Out 

5 

26 

9 

8 

47 

77 

44 

41 

FT  Frequencies 

(N  = 

154) 

Job  Task  No. 

1 

2 

3 

4 

5 

6 

7 

8  ' 

Checked  Out 

148 

125 

134 

143 

116 

93 

100 

102 

Not  Checked  Out 

6 

29 

20 

11 

38 

61 

54 

52 

IC  Frequencies 

(N  ■ 

58) 

Job  Task  No. 

1 

2 

3 

4 

5 

6 

7 

8 

Checked  Out 

57 

45 

49 

44 

41 

26 

33 

27 

Not  Checked  Out 

1 

13 

9 

14 

17 

32 

25 

31 

RD  Frequencies 

(N  • 

139) 

Job  Task  No. 

1 

2 

3 

4 

5 

6 

7 

8 

Checked  Out 

136 

27 

38 

50 

97 

8 

8 

26 

Not  Checked  Out 

3 

112 

101 

89 

42 

131 

131 

113 

RM  Frequencies 

(N  » 

137) 

Job  Task  No. 

1 

2 

3 

4 

5 

6 

7 

8 

Checked  Out 

135 

88 

100 

88 

113 

46 

27 

13 

Not  Checked  Out 

2 

49 

37 

49 

24 

91 

no 

124 

ST  Frequencies 

(N  » 

152) 

Job  Task  No. 

1 

2 

3 

4 

5 

6 

7 

8 

Checked  Out 

144 

118 

119 

117 

121 

103 

77 

80 

Not  Checked  Out 

8 

34 

33 

35 

31 

49 

75 

72 

TM  Frequencies 

(N  ■ 

39) 

Job  Task  No. 

1 

2 

3 

4 

5 

6 

7 

8 

Checked  Out 

38 

31 

32 

31 

34 

14 

18 

8 

Not  Checked  Out 

1 

8 

7 

8 

5 

25 

21 

31 

*The  reader  Is  cautioned  that  a  score  of  NOT  CHECKED  OUT  on  a  task  does  not  dif¬ 
ferentiate  between  whether  a  technician  really  cannot  be  trusted  with  doing  the  task 
on  his  own  without  direct  supervision  or  whether  he  was  given  a  score  of  NOT  CHECKED 
OUT  because  he  does  not  work  at  that  task. 
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Conditional  Frequencies  for  Job  Tasks 


Appendix  J  provides  tables  of  a  more  detailed  analysis  of  some  observations  on  the 
TPCF.  In  particular  the  Job  Task  Conditional  Frequency  Is  given  by  rating;  i.e.,  for 
a  given  task,  the  number  of  Individuals  who  were  CHECKED  OUT  on  each  easier  task  given 
they  were  at  most  CHECKED  OUT  on  the  given  task.  Those  tables  should  provide  more  In¬ 
sight  Into  the  hlerarchlal  classification  of  the  job  tasks  and  also  a  relative  level  of 
technician  competency  by  rating. 

To  Illustrate  the  use  of  the  tables  prepared  In  Appendix  J,  consider  Table  15.  This 
table  represents  the  Job  Task  Conditional  Frequencies  for  the  EM  rating  as  can  be  found 
In  Appendix  J,  page  J-4. 


TABLE  15 

EM  RATING  CONDITIONAL  FREQUENCIES  (N  =  97) 


Job  Task 


8 

7 

6 

5 

4 

3 

2 

1 

55 

46 

33 

50 

50 

50 

52 

55 

17 

4 

13 

14 

17 

17 

17 

6 

6 

5 

5 

4 

6 

6 

5 

6 

6 

6 

3 

3 

3 

3 

6  5  6 

0  0 
2 

The  number  of  men  that  were  not  checked  out  on  any  job 
task  Is  2. 


From  the  first  row  of  Table  15,  55  of  the  97  EM's  were  CHECKED  OUT  at  most  on 
Job  Task  No.  8.  Of  those  55  men,  46  were  also  CHECKED  OUT  on  Job  Task  No.  7  (the  next 
easier  task),  33  were  CHECKED  OUT  on  Job  Task  No.  6,  ....  and  finally  all  55  men  were 
CHECKED  OUT  on  Job  Task  No.  1  (the  easiest  task).  Continuing,  from  the  second  row  of 
the  Conditional  Frequency  table,  17  of  the  97  EM's  were  CHECKED  OUT  at  most  on  Job 
Task  No.  7  (I.e.,  none  of  those  17  men  were  CHECKED  OUT  on  Job  Task  No.  8) .  Again, 
of  those  17  men,  4,  13,  14,  17,  17,  and  17  were  also  CHECKED  OUT  on  Job  Task  No.'s 
6,  5,  4,  3,  2,  and  1  respectively.  Finally,  only  2  men  were  CHECKED  OUT  on  Job  Task 
No.  1,  I.e.,  none  of  those  2  men  were  CHECKED  OUT  on  a  more  difficult  task.  Also, 
there  were  2  men  In  the  EM  rating  that  were  not  CHECKED  OUT  on  any  of  the  eight  tasks. 
Clearly  then  one  would  expect  any  row  of  a  Conditional  Frequency  table  to  contain  al¬ 
most  identical  entries,  I.e.,  If  the  job  tasks  are  truly  hlerarchial  and  representative 
of  tasks  In  that  rating. 
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Consider  now  Appendix  J,  page  J-4,  and  the  Conditional  Frequency  table.  From  the 
first  two  rows  of  that  table,  most  of  the  EM's  CHECKED  OUT  at  most  on  Job  Tasks  7  and 
8  were  also  able  to  complete  the  easier  tasks,  except  for  Job  Task  No.  6.  Again,  that 
task  Is  very  much  out  of  place  In  the  order  of  job  tasks.  There  Is  a  low  degree  of  In¬ 
competence  present  for  13  percent  of  the  EM's  could  be  CHECKED  OUT  at  most  on  no  more 
than  Job  Task  No.  4.  •  However,  It  must  be  realized  that  this  result  could  also  be  due 
to  the  possibility  that  many  of  those  Individuals  simply  do  not  work  at  a  more  difficult 
task  than  Job  Task  No.  4. 

The  ET,  FT,  ST,  and  TM  ratings  (Appendix  J,  pages  J-5,  J-6,  J-10,  and  J-ll  respec¬ 
tively)  demonstrate  practically  the  same  results  for  the  Conditional  Frequency  tables 
as.  the  EM's.  For  those  ratings  8,  10,  9,  and  13  percent  were  CHECKED  OUT  at  most  on  no 
more  than  Job  Task  No.  4  respectively.  The  IC,  RD,  and  RM  ratings  demonstrated  21,  30, 
and  17  percent.  These  remarks  Illustrate  the  practicality  of  the  TPCF  as  an  instrument 
for  evaluating  the  competency  level  of  particular  ratings  and  for  isolating  those  job 
tasks  requiring  further  training  by  electronic  maintenance  technicians. 

It  Is  to  be  noted  that  as  In  the  EM  rating,  Job  Task  No.  6  is  inconsistent  in  most 
of  the  other  ratings  with  respect  to  Its  proper  order  in  the  eight  job  tasks. 

Joint  Frequencies  for  Job  Tasks 

Appendix  J  also  provides  the  Job  Task  Joint  Frequencies  by  rating.  For  each  rating 
this  Is  the  number  of  individuals  who  were  CHECKED  OUT  on  any  two  given  tasks.  Use  of 
the  Joint  Frequency  tables  Is  illustrated  by  Table  16. 


TABLE  16 

EM  RATING  JOINT  FREQUENCIES  (N  =  97) 


1 

2 

3 

4 

5 

6 

7 

8 

95 

87 

87 

77 

75 

43 

63 

55 

87 

84 

73 

70 

40 

63 

52 

87 

71 

69 

40 

62 

50 

77 

69 

40 

56 

50 

75 

42 

56 

50 

43 

35 

33 

63 

46 

55 

From  the  first  row  of  Table  16,  95  of  the  97  EM's  were  CHECKED  OUT  on  Job  Task  No. 
1,  87  (of  the  97  EM's)  were  CHECKED  OUT  on  both  Job  Task  No.'s  1  and  2,  87  were  CHECKED 

OUT  on  Job  Task  No.'s  1  and  3 . and  55  (Of  the  97  EM's)  were  CHECKED  OUT  on  Job 

Task  No.'s  1  and  8.  Similarly,  from  row  2  of  the  Joint  Frequency  table,  87  (of  the  97 
EM's)  were  CHECKED  OUT  on  Job  Task  No.  2,  while  84,  73,  70,  40,  63,  and  52  (of  the  97 
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EM's )  were  CHECKED  OUT  on  both  Job  Task  No.  2  and  Job  Task  No.  3,  4,  5,  6,  7,  and  8 
respectively.  It  Is  well  to  note  that  the  diagonal  entries  of  this  table  corresponds 
exactly  to  the  frequency  entries  for  the  CHECKED  OUT  case  given  In  Table  14. 

Just  as  In  Table  15  on  the  Conditional  Frequencies  one  would  expect  that  any  row  of 
that  table  to  have  almost  Identical  frequencies,  In  a  Joint  Frequency  table  one  would 
expect  any  column  to  contain  Identical  frequencies.  For  example,  completion  of  Job  Task 
No.  5  should  also  Insure  completion  of  Job  Tasks  1,  2,  3,  and  4.  Likewise,  the  rows  of 
the  Joint  Frequency  tables  should  Illustrate  decreasing  frequencies  for  being  CHECKED 
OUT  on  a  task  does  not  Insure  being  CHECKED  OUT  on  a  more  difficult  task. 

From  the  Joint  Frequency  tables  (Appendix  J,  pages  J-4,  J-5,  J-6,  J-7,  and  J-ll) 
for  the  EM,  ET,  FT,  IC,  and  TM  ratings  respectively,  the  previously  mentioned  patterns 
that  are  Illustrated  by  a  Joint  Frequency  table  are  demonstrated  except  for  Job  Task 
No.  6.  This  Is  consistent  with  the  analysis  on  the  Conditional  Frequency  tables.  The 
ST  rating  conforms  almost  exactly  to  the  expected  patterns  for  a  Joint  Frequency  table. 
Unfortunately  there  are  a  few  Instances  In  which  the  Conditional  Frequency  table  for  that 
rating  deviates  from  the  expected  pattern.  In  any  event  the  task  descriptions  on  the 
TPCF  are  very  descriptive  of  the  ST  rating  job  tasks. 

The  RD  rating  Joint  Frequencies  (page  J-8)  Illustrate  the  general  lack  of  patterns 
characteristic  of  a  Joint  Frequency  table.  The  RM  rating  Joint  Frequencies  (page  J-9) 
more  closely  conform  to  the  desired  patterns  but  still  leave  something  to  be  desired. 


Multiple  Comparisons  of  Ships  and  Ratings 


From  either  a  research  or  applied  point  of  view  It  Is  often  necessary  to  compare  the 
performance  levels  of  various  ships  or  ratings.  Such  comparisons  may  be  employed  to  com¬ 
pare  ships  (or  ratings)  relative  to  mean  performance  levels.  However,  such  comparisons 
can  also  offer  a  basis  upon  which  to  formulate  a  decision  as  to  whether  a  particular 
ship  configuration  of  men  and/or  equipment  is,  or  Is  not,  detrimental  to  ship/rating 
performance.  In  a  similar  fashion,  policy  making  decisions  also  can  be  evaluated  with 
respect  to  their  Influence  on  the  performance  of  ships  or  ratings  affected  by  that  policy. 

In  this  section  the  main  subject  of  concern  will  be  the  development  and  justification 
of  a  technique  for  performing  pairwise  comparisons  between  ratings  and  between  ships  on 
the  basis  of  mean  performance  levels  with  respect  to  some  variable.  The  variables  to  be 
considered  are  the  SRE,  PRE,  6RE,  WRE,  and  the  selected  criterion  variable  TP  score.  In 
general  this  subject  falls  under  the  area  of  multiple  comparisons  arising  from  an  Analysis 
of  Variance  (AOV)  of  ship/rating  effects.  The  particular  model 10  to  be  considered  will 
be  a  two-way  fixed  effects  design  with  an  unequal  number  of  observations  for  the  ship/rating 


^®It  is  assumed  that  each  observation  y^  on  the  k^  individual  in  the  it*1  ship  in 
the  jth  rating  Is  due  to  an  overall  effect  (u;,  a  ship  effect  (a^),  and  a  rating  effect 
(0j).  Furthermore,  a  general  model  addresses  the  question  of  the  existence  of  significant 
row-column  Interaction  (<S-h)  upon  each  observation.  In  particular  this  report  addresses 
the  additive  model  of  the  form 

v1jk  =  u  ♦  <*i  +  +  «ij  +  e1jk 

where  e^  Is  an  error  term  associated  with  the  above  model.  In  this  situation  it  is  a 
two-way  fixed  effects  design  with  an  unequal  number  of  observations  In  the  1-jth  cell. 
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combinations  (see  Table  1).  Choice  of  this  model  requires  the  verification  of  normality 
of  the  selected  performance  variable  over  the  main  effects,  homogeneity  of  the  variances 
of  the  main  effects  and  Independence  across  and  between  the  main  effects.11  The  main 
effects  are  "ships"  and  "ratings."  That  performance  variable  to  be  selected  for  per¬ 
forming  the  multiple  comparisons  will,  most  naturally,  be  the  one  which  best  conforms 
to  the  requirements  for  use  of  the  model  being  considered  and  Is  most  associated  with 
technician  on-the-job  performance. 

Distributional  Properties  of  the  Performance  Estimators 

The  g,  test  statistic  for  normality  was  applied  to  the  distribution  of  SRE,  PRE,  GRE, 
and  WRE  values  for  the  949  technicians  In  the  sample  (combined  locations).  Table  17  Il¬ 
lustrates  the  results  of  this  analysis. 


TABLE  17 


91 

TEST  STATISTIC 

VALUES  FOR  THE 

PERFORMANCE 

ESTIMATORS 

SRE 

PRE 

GRE 

WRE 

*1 

.5807 

-.4565 

-4.7092 

.7939 

z 

7.3265 

-5.7599 

-59.4129 

-.5823* 

♦Because  WRE  scores  (Figure  4)  are  almost  normally  dis¬ 
tributed,  a  test  statistic  [4]  similar  to  the  g,  test 
statistic  but  more  sensitive  to  departures  from  normality 
due  to  kurtosls  was  applied  to  the  WRE  scores. 


Recall  that  rejection  of  normality  results  If  |  z  |  >1.96. 

Clearly  then  the  only  estimator  which  appears  to  be  normally  distributed  Is  the 
WRE.  This  same  analysis  was  applied  by  location  and  rating  with  practically  the  same 
results.  In  each  case  only  WRE  scores  proved  to  be  normally  distributed,  except  for 
Isolated  Incidents  of  the  other  estimators.  This  characteristic  of  WRE  scores  is  not 
surprising  as  this  situation  Is  essentially  an  application  of  the  Central  Limit  Theorem 
as  found  In  probability  theory,  see  [12].  The  lack  of  normality  on  the  part  of  the 
other  estimators  Is  not  necessarily  an  undesirable  feature,  but  It  Is  true  that  this 
exercise  does  point  out  yet  one  more  desirable  feature  of  the  WRE,  namely,  Its  general 
normality. 

Choice  of  a  Varl abl e 


As  previously  noted  It  Is  necessary  to  choose  an  appropriate  variable  upon  which 
to  base  the  multiple  comparisons  of  ships  and  ratings.  From  the  previous  section  - 
Distributional  Properties  of  the  Performance  Estimators  -  It  was  observed  that  WRE 
scores  possessed  the  unique  characteristic  among  the  performance  variables  (SRE,  PRE, 
GRE,  and  TP  score)  of  being  normally  distributed.  This  characteristic  of  WRE  scores  Is 
most  helpful  particularly  since  homogeneity  of  variances  In  the  ships,  ratings,  and 


^A  search  of  the  literature  failed  to  locate  a  particular  test  to  employ  for 
independence  In  the  case  of  unequal  numbers  for  the  ship/rating  combinations.  See 
Anderson  [1]  for  the  case  of  equal  numbers. 
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of  the  ship/rating  combinations  Is  a  prerequisite^2  for  the  particular  analysis  of 
variance  design  employed  In  this  report.  The  usual  test  for  homogeneity  of  variances 
(Bartlett  [ 2  J)  Is  extremely  sensitive  to  non-normality.  Therefore,  because  the  SRE, 

PRE,  GRE,  and  even  the  selected  criterion  variable  (TP  score)  are  not  normally  dis¬ 
tributed,  this  characteristic  decreases  their  utility  to  be  employed  within  the  present 
AOV  model.  Furthermore,  it  was  also  shown  In  the  prior  section  -  Validity  of  the 
Performance  Estimators  -  that  the  WRE  Is  the  most  promising  type  of'  performance  estimator 
of  technician  on-the-job  performance.  The  reader  Is  also  referred  to  Appendix  K  which 
presents  In  more  detail  some  considerations  on  the  greater  utility  of  the  WRE  with  re¬ 
spect  to  the  other  performance  estimators.  In  view  of  these  considerations  the  WRE  Is 
certainly  the  most  viable  variable  upon  which  to  base  the  multiple  comparisons  and, 
therefore,  this  report  will  consider  only  ship/rating  comparisons  on  the  basis  of 
technician  Weighted-Average  Reliability  Estimates  (WRE). 

An  Analysis  of  Variance  with  Interaction 

Because  WRE  scores  are  normally  distributed,  Bartlett's  test  (as  found  In  [6]) 
for  evaluating  the  homogeneity  of  variances  across  ships  and  across  ratings  was  ap¬ 
plied  to  the  WRE  scores.  When  all  eight  ratings  were  considered  (21  ships),  equality 
of  rating  variances  was  accepted  while  equality  of  ship  variances  was  rejected.  Re¬ 
vising  the  situation  to  Include  only  the  four  more  promising  ratings  (EM,  ET,  FT,  and 
IC)  to  which  the  WRE  most  applied,  Identical  results  were  obtained.  Clearly  the  non¬ 
verification  of  homogeneity  of  ship  variances  would  make  the  model  being  considered 
less  applicable  to  the  data,  however,  because  In  practice  such  may  not  be  the  case  for 
the  situation  In  which  the  comparisons  are  being  made,  the  analysis  will  continue  here 
under  the  additional  assumption  of  homogeneity  of  ship  variances.  Subsequent  results 
In  this  report  can  be  appropriately  weighed  by  the  reader. 

As  noted  previously,  the  model  being  considered  Is  a  two-way  fixed  effects  design 
with  Interaction.  Upon  observing  Table  1  the  reader  will  realize  that  it  also  must 
Include  the  characteristic  of  unequal  cell  numbers.  Scheffe  [15,  pp.  112-116]  has 
outlined  In  detail  the  procedure  for  performing  multiple  comparisons  under  this  par¬ 
ticular  situation.  Employing  this  procedure  for  the  main  effects  -  8  ratings  and  21 
ships  (N  =  949,  the  total  number  of  observations)  -  Table  18  provides  the  essential 
Information  resulting  from  this  analysis. 

TABLE  18 

AN  ANALYSIS  OF  VARIANCE  FOR  21  SHIPS  AND  8  RATINGS 


Source 

Degrees  of 
Freedom 

Sum  of 
Squares 

Mean 

Square 

F  Value 

Total 

949 

384.2407 

Between  Ships 

20 

5.0938 

.2547 

7.0904* 

Between  Rating 

7 

.7155 

.1022 

2.8458* 

Ship  by  Rating  Interaction 

140 

12.3940 

.0885 

3.3420* 

Residual 

781 

20.6885 

.0265 

♦Indicates  significance  at  the  a 

=  .05  level. 

12Scheffe  [15]  has  noted  that  non-normality  has  little  effect  on  Inferences  about 
means  but  serious  effects  on  Inferences  about  variances.  Furthermore,  Inequality  of 
variances  In  the  cells  of  a  layout  has  serious  effects  on  Inferences  about  means  in  lay¬ 
outs  with  unequal  cell  numbers  (see  Table  l). 
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An  Identical  AOV  was  executed  as  above  but  for  the  four  ratings  (EM,  ET,  FT,  and 
IC)  for  which  the  performance  measurement  technique  was  most  promising.  Table  19  re¬ 
flects  the  results  of  this  AOV. 


TABLE  19 


AN  ANALYSIS 

OF  VARIANCE  FOR  21 

SHIPS  AND 

4  RATINGS 

Source 

Degrees  of 
Freedom 

Sum  of 
Squares 

Mean 

Square 

F  Value 

Total 

482 

192.0419 

Between  Ships 

20 

2.669 

.1334 

3.884* 

Between  Rating 

3 

.5621 

.1874 

5.4598* 

Ship  by  Rating  Interaction 

60 

4.0437 

.0674 

2.2975* 

Residual 

398 

11.6747 

.0294 

indicates  significance  at  the  a  =  .05  level. 


In  either  of  the  above  two  AOV  tables  there  exists  significant  ship/rating  inter¬ 
action.  This  situation  will  not  permit  the  comparing  of  any  two  of  the  main  effects 
under  a  two-way  design  because  of  the  confounding  of  the  main  effects  with  the  inter¬ 
action  terms.  The  only  recourse  is  to  test  for  significant  differences  In  each  ship, 
across  ratings,  or  In  each  rating,  across  ships.  If  the  interaction  terms  were  not 
significant,  it  would  be  an  easy  matter  to  compare  ratings  and  to  compare  ships  by  em¬ 
ploying  the  entire  set  of  data  represented  In  the  AOV's  of  Table  18  or  Table  19,  see 
again  Scheffe  [15]. 

Testing  for  Significant  Ship  (Rating)  Effects  for  a  Particular  Rating  (Ship) 

In  order  to  develop  comparisons  between  ships  (for  a  fixed  rating)  and  to  develop 
comparisons  between  ratings  (for  a  fixed  ship),  this  report  will  employ  an  AOV  model13 
resulting  from  a  one-way  fixed  effects  design  with  unequal  numbers  of  observations 
across  the  main  effects.  Homogeneity  of  the  variances  across  the  main  effects  must  be 
assumed  In  this  case  for  the  usual  tests  are  large  sample  tests  and  inapplicable  for 
ship/rating  numbers  less  than  ten  (see  Layard  [14]  and  Table  1). 

For  present  purposes  only  the  AOV's,  and  subsequent  multiple  comparisons,  will  be 
developed  on  the  21  ships  participating  in  the  project  and  the  four  ratings  EM,  ET,  FT, 
and  IC.  This  will  involve  25  different  AOV's  to  be  constructed  and  subsequently  de¬ 
veloped  for  multiple  comparison  of  the  main  effects  if  the  AOV  indicates  significant 
main  effects. 


13This 


report  will  employ  a  model  of  the  form 


Y-f jk  =  u  +  a1  +  e^k  (j  is  fixed  and  i=l,  ...,  21) 

for  testing  for  significant  ship  effects,  and  a  model  of  the  form 

Y1jk  =  v  +  +  e^k  (1  Is  fixed  and  j=l,  ....  4) 

for  testing  for  significant  rating  effects.  The  subscript  k  is  an  index  representing 
the  k*"  man  in  that  main  effect. 
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Inltally  the  hypothesis  of  equality  of  mean  WRE  scores  was  tested  for  the  four 
ratings  EM  ,ET,  FT,  and  IC  for  each  of  the  21  ships.  This  hypothesis  was  accepted 
for  12  of  the  21  ships.  On  the  remaining  9  ships  Scheffe's  multiple  comparison 
technique  was  applied  In  searching  for  a  possible  significant  difference  between  any 
two  (of  the  four)  ratings  on  the  basis  of  mean  WRE  scores.  Table  20  reflects  the  re¬ 
sults  of  these  multiple  comparisons,  each  derived  from  a  separate  Analysis  of  Variance. 
(The  resulting  21  AO V  tables  are  too  extensive  to  be  presented  In  this  report). 

Finally  the  hypothesis  of  equality  of  mean  WRE  scores  was  tested  for  the  21  ships 
for  each  of  the  four  ratings  EM,  ET,  FT,  and  IC.  This  hypothesis  was  rejected  for  each 
of  the  four  ratings.  No  significant  differences  were  found  between  any  pair  of  the 
ratings  using  Scheffe's  multiple  comparison  technique.  This  Is  not  an  Inconsistent 
result,  for  this  could  be  a  result  of  trying  to  perform  too  many  multiple  comparisons 
(therefore,  Increasing  the  comparison  error  rate)  and/or  the  effect  referenced  In  the 
footnote  of  Table  20. 


TABLE  20 

MULTIPLE  COMPARISON  OF  FOUR  RATINGS  ON  NINE  SHIPS* 


Ship 

Highest 

Mean  WRE 

Lowest 
Mean  WRE 

a 

EM 

FT 

ET 

IC 

b 

FT 

ET 

EM 

IC 

c 

EM 

ET 

IC 

FT 

d 

ET 

FT 

EM 

IC 

e 

IC 

EM 

ET 

FT** 

f 

IC 

ET 

FT 

EM** 

g 

FT 

IC 

EM 

ET 

h 

EM 

ET 

IC 

i 

EM 

ET 

FT 

*For  each  ship  a  line  under  two  ratings  signifies  no 
significant  difference  between  the  ratings. 

**It  Is  Important  to  note  that  while  no  differences 
In  rating  means  were  detected,  the  rejection  of  the  null 
hypothesis  of  the  equality  of  rating  means  Is  not  In 
error.  This  only  Implies  that  some  contrast  other  than 
those  contrasts  testing  rating  differences  lead  to  that 
rejection,  see  Ferguson  [8,  pp.  279-283]. 
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Association  Between  Demographic  and  Performance  Variables 


Usually  It  is  of  interest  from  either  a  research  or  applied  point  of  view  to  esti¬ 
mate  school  success,  final  grade,  etc.  of  an  Individual  In  some  training  program  or 
school  by  employing  such  predictor  variables  as  the  Basic  Test  Battery  (BTB)  scores  -  GCT, 
ARI,  MECH,  and  CLER  scores  or  combinations  of  those  scores.  Typically  BTB  scores  are 
used  to  predict  actual  school  success  which  In  turn  is  viewed  as  being  the  best  available 
measure  of  potential  job  success.  Seldom,  however,  are  direct  measures  of  on-the-job 
performance  available  as  those  developed  In  the  current  study.  Accordingly  the  relation¬ 
ship  between  the  BTB  scores  -  GCT,  ARI,  and  Skill  (GCT  +  ARI)  -  and  measures  of  on-the-job 
performance  -  SRE,  PRE,  GRE,  WRE,  and  TP  score  -  was  investigated. 

Besides  the  BTB  scores,  other  available  predictor,  variables  were  also  considered 
under  the  general  heading  of  demographic  variables.  In  this  report  the  demographic 
variables  to  be  considered  are:  months  known  by  supervisor,  months  on  current  job 
assignment,  GCT  score,  ARI  score,  SKILL  (GCT  +  ARI)  score,  and  A,  B,  and  C  school  final 
grade.  The  performance  variables  that  will  be  employed  to  relate  to  on-the-job  technician 
performance  are  the  eight  reliability  ratios  relative  to  the  job  activity  factors  on  the 
JPQ  ANSWER  SHEET,  and  the  variables  SRE,  PRE,  GRE,  WRE,  and  TP  score. 


Utility  of  Demographic  Variables  In  Performance  Prediction 

In  order  to  determine  the  utility  or  effectiveness  of  the  demographic  variables 
previously  introduced  to  relate  or  be  associated  with  on-the-job  technician  performance, 
product-moment  correlation  coefficients  were  developed  between  those  demographic  vari¬ 
ables  and  the  performance  variables.  From  this  analysis  it  is  possible  to  Infer  the 
extent  which  the  demographic  variables  may  be  viewed  as  linear  predictors  of  the  demo¬ 
graphic  variables. 


Demographic  Variable  Prediction  on  Combined  Locations 

Table  21  reflects  the  product-moment  correlation  coefficients  that  resulted  when 
the  949  technicians  were  considered.  In  that  table  there  are  many  product-moment  cor¬ 
relation  coefficients  significantly  different  from  zero,  but  they  are  of  such  low 
magnitude.  Now  from  a  linear  prediction  standpoint,  the  multiple  correlation  coefficient 
(Rz)  Is  related  to  the  product-moment  correlation  coefficient  (r„y)  by  R2  =  rjL.  (x 
Is  one  of  the  demographic  variables  and  y  Is  a  performance  variable.)  Therefore,  from 
Table  21,  even  for  the  largest  r„y  value  observed,14  namely  0.217,  the  Rz  value  for 
this  case  Is  still  a  very  low  0.047  for  the  degree  of  fit  of  the  linear  model  to  the 
data  (x  Is  SKILL  score  and  y  Is  TP  score).  However,  even  with  the  low  correlations 
represented  by  the  BTB  scores,  those  scores  do  offer  some  hope  of  predicting  on-the-job 
performance  as  measured  by  the  TPCF.  The  correlation  coefficients  reflect  the  degree 
of  association  that  Is  typically  found  between  predictor  variables  and  on-the-job 
performance.  However,  these  results  show  considerable  promise  for  further  research  in 
the  area  of  the  development  of  on-the-job  performance  measures. 


Demographic  Variable  Prediction  in  the  EM,  ET,  FT,  and  IC  Ratings 

In  a  similar  manner  product-moment  correlation  coefficients  were  developed  between 
the  demographic  and  performance  variables  for  the  technicians  sampled  from  the  four 
more  promising  ratings  EM,  ET,  FT,  and  IC.  In  Table  22  are  the  results  of  this  analysis. 
From  this  table  the  same  observations  as  above  can  be  made  for  this  case  since  no  pro- 
duct-moment  correlation  Is  greater  than  0.217,  the  largest  previously  observed.  Also, 
as  In  the  above,  some  hope  Is  offered  by  BTB  scores  for  predicting  on-the-job  performance 
as  measured  by  the  TPCF.  The  correlation  coefficients,  though  suppressed,  are  still  of 
sufficient  magnitude  to  warrant  some  promise  for  further  research. 


^Excluding  B  school  final  score  which  has  such  a  low  sample  size  represented. 
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TABLE  21 


DEMOGRAPHIC  CORRELATIONS  ON  EIGHT  RATINGS 


Reliability  Ratios 


Ref 

Equip 

Clr 

Pers 

Elec 

Elec 

Elec 

N 

Mat 

Op 

Anal 

Rel 

Safe 

Inst 

Rep 

Cog 

Mo  known  by  super 

948 

0.032 

0.068* 

-0.006 

-0.020 

0.038 

0.001 

-0.069* 

-0.036 

Mo  on  current  assign 

948 

0.029 

0.106* 

-0.005 

-0.034 

0.057 

-0.013 

0.012 

-0.009 

GCT  scores 

909 

-0.027 

-0.034 

-0.048 

-0.078* 

-0.014 

-0.096* 

-0.050 

-0.076* 

ARI  scores 

909 

0.018 

-0.014 

-0.030  . 

-0.086* 

-0.031 

-0.076* 

-0.039 

-0.022 

SKILL  scores 

909 

-0.006 

-0.029 

-0.046 

-0.095* 

-0.027 

-0.100* 

-0.052 

-0.057 

A  school  final  grade 

774 

0.089* 

0.090* 

0.046 

0.038 

0.017 

0.082* 

0.104* 

0.101* 

B  school  final  grade 

16 

-0.022 

0.379 

0.227 

0.231 

0.178 

0.323 

-0.044 

0.300 

C  school  final  grade 

264 

0.016 

0.077 

0.006 

0.000 

-0.054 

-0.009 

0.119 

0.079 

Performance  Estimators 

N 

SRE 

PRE 

GRE 

WRE 

TP  Score 

Mo  known  by  super 

948 

-0.029 

-0.038 

0.055 

0.011 

0.086* 

Mo  on  current  assign 

948 

0.067* 

0.036 

0.044 

0.070* 

0.191* 

GCT  scores 

909 

-0.119* 

-0.100* 

-0.040 

0.018 

0.186* 

ARI  scores 

909 

-0.076* 

-0.066* 

-0.013 

0.037 

0.193* 

SKILL  scores 

909 

-0.111* 

-0.095*  ■ 

-0.034 

0.032 

0.217* 

A  school  final  grade 

774 

0.142* 

0.096* 

0.084* 

0.098* 

0.070* 

• 

B  school  final  grade 

16 

0.339 

0.387 

0.167 

0.265 

-0.173 

C  school  final  grade 

264 

0.041 

0.027 

0.047 

0.092 

0.091 

♦Significantly  different  from  zero  at  the  a  =  .05  level. 
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TABLE  22 


DEMOGRAPHIC  CORRELATIONS  ON  FOUR  RATINGS 


Reliability  Ratios 


N 

Ref 

Mat 

Equip 

Op 

Clr 

Anal 

Pers 

Rel 

Elec 

Safe 

Inst 

Elec 

Rep 

Elec 

Cog 

Mo  known  by  super 

481 

-0.043 

-0.021 

-0.097* 

-0.055 

0.025 

-0.085 

-0.062 

-0.084 

Mo  on  current  assign 

482 

-0.035 

0.093* 

-0.034 

-0.044 

0.064 

0.032 

0.081 

-0.019 

GCT  scores 

459 

-0.045 

-0.001 

0.026 

-0.072 

-0.047 

-0.013 

0.008 

-0.007 

ARI  scores 

459 

-0.002 

0.014 

0.026 

-0.094* 

-0.035 

0.006 

-0.008 

0.032 

SKILL  scores 

459 

-0.026 

0.007 

0.030 

-0.093* 

-0.046 

.  -0.003 

0.001 

0.014 

A  school  final  grade 

383 

0.086 

0.107* 

0.047 

0.009 

0.057 

0.063 

0.067 

0.088 

B  school  final  grade 

10 

-0.342 

0.322 

0.103 

0.129 

-0.201 

0.328 

-0.225 

0.250 

C  school  final  grade 

164 

0.004 

0.051 

-0.057 

0.016 

-0.103 

-0.097 

-0.018 

0.085 

Performance  Estimators 

N 

SRE 

PRE 

GRE 

WRE 

TP  Score 

Mo  known  by  rater 

481 

-0.083 

-0.096* 

-0.005 

-0.040 

0.089* 

Mo  on  current  assign 

482 

0.017 

0.014 

0.088* 

0.062 

0.214* 

GCT  scores 

459 

-0.050 

-0.081 

0.008 

0.065 

0.172* 

ARI  scores 

459 

-0.033 

-0.056 

0.016 

0.048 

0.144* 

SKILL  scores 

459 

-0.047 

-0.077 

0.014 

0.064 

0.178* 

A  school  final  grade 

383 

0.071 

0.049 

0.112* 

0.125* 

0.167* 

B  school  final  grade 

10 

0.028 

0.213 

-0.010 

0.027 

-0.265 

C  school  final  grade 

164 

-0.003 

-0.045 

-0.019 

0.080 

0.135 

♦Significantly  different  from  zero  at  the  a  =  .05  level. 
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SUMMARY  AND  CONCLUSIONS 


Summary  of  Data  Analyses 


Evaluation  of  the  Performance  Estimators 


When  evaluating  a  performance  estimator  It  Is  initially  of  interest  to  consider  the 
degree  to  which  that  estimator  does  in  fact  measure  an  individual's  on-the-job  perform¬ 
ance.  In  order  to  address  this  particular  aspect  of  the  analyses  it  was  necessary  to 
choose  an  appropriate  criterion  measure  of  on-the-job  performance.  The  variable  selected 
as  the  criterion  measure  In  this  report  was  Technical  Proficiency  (TP)  score  (or  Tech¬ 
nical  Proficiency  Checkout  (TPC)  level)  as  derived  from  the  Technical  Proficiency  Check¬ 
out  Form  (TPCF).  Prior  research  efforts  demonstrated  that  this  variable  was  a  viable 
criterion  variable.  Initially  triserial  correlation  coefficients  were  developed  between 
the  TPC  level  and  each  of  the  performance  estimators  (SRE,  PRE,  GRE,  and  WRE)  being 
evaluated.  Essentially  due  to  the  lack  of  normality  of  the  continuous  variable  TP  score, 
triserial  correlation  had  to  be  considered  inappropriate  for  the  data  collected  in  the 
course  of  this  project.  Finally  a  curvilinear  regression  analysis  was  executed  between 
each  of  the  performance  estimators  and  TP  score  with  an  emphasis  upon  a  least-squares 
interpretation  of  the  corresponding  results. 

When  the  entire  sample  of  949  technicians  was  considered,  relatively  low  multiple 
correlation  coefficients  corresponding  to  a  linear,  quadratic,  and  cubic  model  were 
obtained.  Furthermore,  low  product-moment  correlation  coefficients  were  obtained  for 
some  estimators.  Due  to  these  results  it  was  decided  that  a  more  appropriate  approach 
to  analyzing  the  data  would  be  an  analysis  by  rating.  That  is  also  a  more  appropriate 
approach  for  job  tasks  or  job  activities  would  be  more  homogeneous  within  a  particular 
rating. 

When  the  individual  ratings  were  considered  it  could  be  concluded  that  of  the  four 
performance  estimators  -  SRE,  PRES  GRE,  and  WRE  -  the  WRE  possesses  the  greatest  degree 
of  promise  in  all  ratings.  The  o»^ly  exceptions  occur  for  the  ET  and  RD  ratings  in  which 
the  GRE  is  slightly  better  and  none  of  the  estimators  apply,  respectively.  The  WRE  is  a 
moderate  estimate  of  absolute  technician  performance  in  the  EM,  ET,  FT,  and  IC  ratings 
and  a  modest  estimate  of  absolute  performance  in  the  RM,  ST,  and  TM  ratings.  It  is  recom¬ 
mended  that  the  WRE  be  applied,  in  particular,  upon  the  EM,  ET,  FT,  and  IC  ratings  for 
purposes  of  comparing  individuals  or  groups  of  individuals  in  those  ratings.  In  fact, 
it  is  suggested  that  in  most  analyses  where  the  performance  of  an  individual,  or  group 
of  individuals  in  those  ratings  is  needed,  (i.e.,  an  estimate  of  the  probability  of  ef¬ 
fective  performance  is  required)  that  the  WRE  be  employed.  Usually  these  analyses  would 
involve  a  classification  or  discrimination  of  such  individuals  on  the  basis  of  their 
present-day  on-the-job  performance.  However,  use  of  the  WRE  in  the  RM,  ST,  and  TM  ratings 
is  not  as  justified  and,  therefore,  if  used  in  those  ratings,  it  should  be  only  with  utmost 
caution  with  regard  to  its  low  validity,  as  determined  by  the  TPCF. 

The  Criterion  Measure  of  On-the-Job  Performance 


Because  the  TPCF  was  employed  as  a  criterion  measure  of  technician  on-the-job 
performance,  an  analysis  of  the  extent  to  which  its  properties  were  verified  by  the 
data  collected  in  this  project  was  considered.  To  achieve  this  end  Conditional  and 
Joint  Frequency  tables  were  developed  by  rating  to  determine  whether  the  hlerarchial 
classification  of  the  job  tasks  was  in  effect  and  whether  the  job  tasks  were  appropriate 
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to  present-day  electronic  maintenance  activities.  Results  from  those  tables  revealed 
that  only  one  job  task  -  capable  of  calibrating  most  of  this  unit's  equipment  with  which 
his  rating  Is  concerned  -  was  more  dated  than  the  other  job  tasks.  With  this  exception 
the  job  tasks  seemed  to  follow  a  hlerarchlal  classification  In  all  but  the  RM  rating, 
and  to  a  lesser  degree  In  the  RD  rating.  From  these  analyses  It  Is  suggested  that  the 
following  alterations  be  completed  by  a  potential  user  before  the  TPCF  Is  employed  either 
In  an  operational  or  research  context: 

1.  An  updating  of  the  job  task  descriptions  by  rating.  It  is  not 
likely  that  a  list  of  task  descriptions  can  be  developed  that  are 
characteristic  of  the  population  of  electronics  maintenance  person¬ 
nel  without  being  too  general  and  not  specific  enough  for  their 
Intended  use  In  any  rating. 

2.  A  verification  of  the  hlerarchial  classification  of  the  up¬ 
dated  task  descriptions  by  rating. 

3.  Revision  of  the  TPCF  to  Include  an  answer  column  that  would 
reflect  whether  the  technician  actually  works  at  the  task  descrip¬ 
tion  being  considered. 

4.  Development  of  alternative  test  statistics  that  would  reflect 
the  hlerarchial  classification  of  the  job  tasks  which  TP  score  does 
not  do.  Suggested  random  variables  to  consider  are: 

X  =  the  highest  job  task  the  technician  Is  CHECKED  OUT 
on,  or 

Y  =  (X  +  TP  score  )/2. 

Use  of  X  In  a  rating  is  most  warranted  If  the  hlerarchial  clas¬ 
sification  Is  correct;  if  not,  use  of  Y  will  "average"  the  effects 
of  X  and  TP  score. 

5.  A  validation  by  rating  that  the  TPCF  is  highly  predictive  of 
on-the-job  performance  for  that  rating. 

In  conclusion  It  can  be  said  that  the  TPCF  represents  the  most  promising  of  the 
performance  Instruments  evaluated.  It  Is  certainly  the  most  easily  administered  and 
offers  the  least  amount  of  confusion  to  the  evaluator.  Furthermore,  the  possibility 
of  deriving  competency  levels  from  the  Conditional  Frequency  tables  offers  an  alter¬ 
native  procedure  for  comparing  ratings  or  groups  of  technicians  within  a  rating  on  the 
basis  of  the  proportion  of  Individuals  CHECKED  OUT  at  most  on  a  certain  task.  Although 
such  comparisons  were  not  attempted  In  this  report,  it  certainly  Is  an  appropriate  topic 
for  future  research  on  the  TPCF. 

Comparisons  Between  Ships  and  Ratings 

Multiple  comparisons  between  ratings  and  between  ships  was  accomplished  in  this 
report  by  means  of  appropriate  fixed-effect  additive  Analysis  of  Variance  (AOV)  models. 
Use  of  these  models  required  the  homogeneity  of  variances  across  the  main  effects  (ships 
and/or  ratings),  normality  of  the  variable  upon  which  the  comparisons  are  to  be  based, 
and  independence  of  the  observations  across  ships  and  ratings.  The  performance  variable 
selected,  from  among  SRE,  PRE,  6RE,  WRE,  and  TP  score,  was  that  one  which  best  conformed 
to  the  above  requirements  and  could  be  most  associated  with  technician  on-the-job  per¬ 
formance.  Initially  this  Involved  the  Investigation  of  the  distributional  properties 
of  each  of  the  performance  variables.  The  distributions  of  the  variables  SRE,  PRE,  GRE, 
and  TP  score  were  all  shown  to  be  non-normal  for  the  subpopulations  considered.  This 
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characteristic  of  those  variables  Is  only  detrimental  in  AOV  analyses  for  the  case  of 
unequal  number  of  observations  for  the  ship-rating  combinations,  which  was  the  case  for 
the  data  collected  In  this  report  (see  Table  1).  Essentially  the  difficulty  arises 
when  one  attempts  to  apply  a  test  of  homogeneity  of  variances  for  the  variable  considered. 
The  standard  tests  for  homogeneity  of  variance  require  normality  of  the  variable  con¬ 
sidered. 

Only  the  variable  WRE  could  be  termed  normally  distributed  for  all  the  subpopula¬ 
tions  considered.  Furthermore,  it  was  shown  to  be  the  most  promising  type  of  perform¬ 
ance  estimator,  particularly  in  the  EM,  ET,  FT,  and  IC  rating.  In  view  of  these  and 
other  related  considerations  It  was  the  most  optimal  choice  of  a  performance  variable 
upon  which  to  base  the  multiple  comparisons.  Unfortunately,  not  all  the  requirements 
for  use  of  the  AOV  models  to  be  employed  were  satisfied  by  the  WRE,  however,  the 
techniques  employed  to  that  end  demonstrate  the  procedures  that  one  should  go  through 
in  order  to  validly  apply  the  AOV  models. 

Initially  a  two-way  fixed  effects  design  was  applied  to  the  data.  However,  be¬ 
cause  significant  Interaction  was  found  to  exist  between  ships  and  ratings,  this 
necessarily  forced  multiple  comparisions  between  ships  (ratings)  to  be  performed  for 
a  fixed  rating  (ship).  Twenty-five  AOV's  were  executed  in  that  event  in  order  to  detect 
significant  mean  WRE  scores  between  the  four  more  promising  ratings  (EM,  ET,  FT,  and  IC) 
for  each  of  the  21  ships  In  the  project  and  between  the  21  ships  for  each  of  these  four 
ratings.  No  particular  pattern  seemed  to  emerge  across  ships  as  to  which  rating  Is 
more  proficient  (in  terms  of  mean  WRE  scores).  Furthermore,  no  pairwise  significant 
difference  was  detected  between  any  two  ships  (for  any  of  the  four  ratings). 

In  conclusion  It  would  seem  that  the  WRE  is  the  most  appropriate  performance 
variable  upon  which  to  base  the  multiple  comparison  of  ships  and  ratings.  However,  it 
would  be  a  valuable  exercise  for  a  user  to  also  Include  the  other  candidate  performance 
variables  and  choose  that  variable  most  appropriate  to  the  characteristics  of  the  data 
collected.  Likewise,  the  application  of  the  appropriate  variable  for  particular  ship¬ 
rating  configurations  may  yield  insignificant  ship-rating  interaction,  thus  eliminating 
some  of  the  difficulties  encountered  In  this  report.  In  particular  it  is  the  user's 
responsibility  to  test  the  requirements  and  various  configurations  before  deciding  on  a 
particular  technique  for  performing  multiple  comparisons.  It  is  hoped  that  the  pro¬ 
cedure  employed  in  this  report  offers  some  guidelines  to  the  potential  user  for  ap¬ 
plication  of  the  performance  measurement  technique  being  researched. 

Analysis  of  Demographic  Data 

In  addition  to  the  performance  data  collected  on  the  TPCF  and  JPQ  ANSWER  SHEET, 
demographic  data  were  collected  by  means  of  the  Personnel  Identification  Information 
Form  (PI I F) .  The  demographic  variables  that  were  subsequently  studied  were:  months 
known  by  rater5  months  on  current  job  assignment,  GCT  and  ARI  scores,  and  A,  B,  and 
C  school  final  grades.  Product-moment  correlation  coefficients  were  developed  between 
those  variables  and  the  SRE,  PRE,  GRE,  WRE,  TP  score  and  each  of  the  eight  job  activity 
reliability  ratios.  Although  the  resulting  correlations  were  low,  some  hope  was  offered 
by  GCT  and  ARI  scores  for  predicitng  on-the-job  performance  as  measured  by  TP  scores. 

It  is  felt  that  further  research  In  this  area  may  reveal  that  Basic  Test  Battery  scores 
have  some  utility  for  predicting  job  performance  levels. 


Observations  on  the  Use  of  Composite  Reliability  Values 


It  will  be  observed  that  many  of  the  analyses  chosen  for  analyzing  the  data  rest 
upon  the  particular  characteristics  observed  in  the  data,  e.g.,  distributional  properties 
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of  the  data.  This  is  a  reasonable  and  preferred  procedure  to  follow  in  order  to  form 
an  opinion  based  on  the  data  collected.  However,  there  was  one  necessary,  and  arti¬ 
ficial,  revision  of  the  fundamental  characteristics  of  the  original  data  that  was  re¬ 
quired  In  order. to  arrive  at  a  numeric  estimate  of  performance  based  on  the  estimators 
SRE,  PRE,  GRE,  and  WRE.  That  revision,  of  course,  Involved  the  adoption  of  a  con¬ 
vention  to  estimate  technician  performance  for  those  cases  in  which  the  technician 
either  does  not  work  at  a  job  activity  or  received  £UE  =  EUI  =  0.  The  choice  of  a 
composite  reliability  value  (Appendix  F)  to  estimate  technician  performance  In  those 
cases  cannot  be  viewed  as  the  most  optimal  choice.  However,  it  Is  certainly  a  reason¬ 
able  and  efficient  means  of  employing  the  original  data  In  order  to  achieve  perform¬ 
ance  estimates  In  those  cases.  Reasonable  In  the  sense  that  this  estimate  Is  derived 
as  the  Individual  job  activity  reliability  ratios  are  derived,  l.e.,  by  totaling  the 
number  of  UE's  and  UI's  observed  and  forming  the  ratio  EUE/[EUE  +  EUI].  Therefore, 
it  should  be  no  less  objectlonal  than  are  the  reliability  ratios.  Furthermore,  it  Is 
efficient  In  the  sense  that  no  complicated  mathematical  procedure  Is  required  in  order 
to  derive  the  composite  reliability  values. 

The  composite  reliability  values  were  derived  by  location  (Table  F-2)  and  it  was 
those  values  which  were  subsequently  employed  throughout  the  remainder  of  the  analyses. 

A  better  procedure  would  have  been  to  derive  a  composite  reliability  value  for  the 
total  of  N  =  949  technicians  and  employ  those  values  for  subsequent  analyses  rather 
than  by  the  use  of  "per  location"  composite  reliability  values.  However,  as  can  be 
observed  in  Table  F-2,  the  composite  reliability  values  do  not  differ  significantly 
by  location  except  In  two  cases:  Job  Activity  No.  7  In  the  RD  rating  and  Job  Activity 
No.  3  In  the  TM  rating. 

Effect  of  the  Convention  on  the  Performance  Estimates  SRE,  PRE,  and  GRE 

The  Convention  In  the  RD  Rating 

For  the  RD  rating  the  composite  reliability  value  Is  0.0  for  Job  Activity  No.  7  at 
Location  No.  2  (Table  F-2).  However,  at  Location  No.  2  the  RD's  received  SRE  =  PRE  =  0.0 
(see  p.  3  and  footnote  2)  because  all  (but  one)  RD  at  that  location  either  did  not  work 
at  Job  Activity  No.  7  or  received  SUE  =  ZUI  =  0  (see  Table  E-l).  In  addition  to  the 

low  SRE  and  PRE  scores  resulting  from  the  use  of  this  convention  at  Location  No.  2,  it 

must  be  pointed  out  that  low  scores  were  likewise  recorded  for  the  TPCF  at  that  location 
(Table  4).  This  effect  would  result  In  a  high  degree  of  association  between  the  pre¬ 
dictor  and  criterion  variables  for  the  RD  rating  at  Location  No.  2  because  low  predictor 
scores  are  corresponding  to  low  criterion  scores.  This  situation,  however,  is  unique 
to  the  RD  rating  at  Location  No.  2. 

At  Location  No.  1  the  situation  of  a  high  degree  of  association  between  the  predictor 
and  criterion  variables  was  not  Illustrated  for  the  RD  rating.  As  at  Location  No.  2, 
most  of  the  RD  technicians  are  In  the  lowest  TPC  levels  (Table  3)  and  every  RD  at  Loca¬ 
tion  No.  1  did  not  work  at  Job  Activity  No.  7  or  received  IUE  =  EUI  =  0  (Table  E-l). 
However,  all  the  composite  reliability  values  are  high  for  Location  No.  1  (see  Table  F-2) 
Implying  that  most  likely  the  SRE  and  PRE  are  different  from  zero  and  of  a  large  magni¬ 
tude.  This  characteristic  of  the  SRE  and  PRE  would  imply  an  inconsistency  with  the  low 

TPC  levels  recorded  at  Location  No.  1.  Namely,  an  inverse  relationship  has  been  created 
at  Location  No.  1  essentially  due  to  the  convention  that  was  adopted.  That  is,  high 
predictor  scores  correspond  to  low  TPCF  scores  in  the  RD  rating,  whereas  at  Location 
No.  2,  low  predictor  scores  are  associated  with  low  TPCF  scores.  It  may  be  said  that 
this  effect  at  Location  No.  1  has  significantly  contributed  to  the  low  correlation 
values  that  were  subsequently  calculated  (see  Tables  6  and  7).  However,  in  terms  of 
composite  reliability  values,  the  correlations  are  most  correct  at  Location  No.  1.  Only 
at  Location  No.  2,  where  as  previously  noted,  there  Is  an  Inconsistency  in  the  composite 
reliability  values,  were  the  performance  estimators,  SRE,  PRE,  and  GRE  able  to  correspond 
to  the  low  TPC  levels  and,  thus,  Incidentally,  produce  higher  correlations.  Therefore, 
the  correlations  obtained  at  Location  No.  1  probably  reflect  the  most  accurate  portrayal 
of  the  use  of  composite  reliability  values. 
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The  Convention  In  Other  than  the  RD  Rating 

Now  except  for  the  extreme  case  mentioned  above  in  the  RD  rating,  all  other  com¬ 
posite  reliability  values  in  Table  F-2  are  high.  This  is  in  close  agreement  with  the 
TPCF  results  (Tables  3  and  4)  for  the  EM,  ET,  FT,  and  IC  ratings.  The  distribution 
of  TPC  levels  for  those  ratings  demonstrate  a  high  concentration  of  individuals  in 
the  highest  level  of  technical  proficiency.  On  the  other  hand,  in  the  RM,  ST,  and  TM 
ratings,  the  distribution  of  TPC  levels  is  uniform  or  demonstrate  a  higher  concentra¬ 
tion  of  technicians  in  the  lowest  level  of  technical  proficiency,  but  the  composite 
reliability  values  are  high. 

Now  it  is  difficult  to  generalize  as  to  how  the  above  observations  are  reflected 
in  the  estimators  SRE,  PRE,  GRE,  and  WRE  for  association  with  TPCF  results.  This  de¬ 
pends  on  the  frequency  with  which  the  composite  reliability  values  are  used  (Table 
E-l).  However,  it  seems  true  that  the  greater  the  frequency  of  use  of  the  composite 
reliability  value  the  less  agreement  of  the  TPCF  with  the  reliability  estimators. 

Observations  on  the  Use  of  Composite  Reliability  Values 

As  with  any  convention  one  employs,  there  seems  to  be  a  degree  of  artificality  in 
the  composite  reliability  values,  for  it  would  probably  be  easy  to  select  a  convention, 
by  rating  perhaps,  which  would  allow  the  estimators  to  have  a  significant  degree  of 
promise  in  all  ratings.  This,  of  course,  is  a  most  inappropriate  means  by  which  to 
evaluate  an  estimator.  However,  results  of  this  research  effort  seem  to  indicate  that 
it  is  not  the  use  of  any.  convention  that  is  posing  difficulty,  but  rather  its  overuse. 
As  discussed  in  AppenHTx  E,  there  were  42  (out  of  164)  rating-job  activity  combinations 
where  the  convention  had  to  be  employed  on  at  least  one-third  of  the  technicians  in 
some  job  activity  and  rating.  Such  a  high  use  of  a  convention  can  only  force  the 
individual  performance  estimates  (in  particular  the  SRE,  PRE,  and  GRE)  to  more  reflect 
the  effect  of  the  convention  rather  than  individual  performance. 

This  observation  is  further  reinforced  with  the  WRE  by  the  frequency  with  which 
it  must  employ  the  convention.  This  estimator  only  employs  the  convention  for  the 
case  in  which  the  technician  received  ZUE  =  ZUI  =  0.  The  case  in  which  the  technician 
did  not  work  at  the  job  activity  is  ignored  by  this  estimator.  Table  K-l  reflects  the 
improvement  in  nonuse  of  the  convention.  It  is  believed  that  in  no  small  way  does  con¬ 
sidering  only  the  job  activities  a  technician  works  at  and  then  appropriately  weighting 
those  to  form  a  reliability  value  permit  a  greater  reflection  of  individual  performance 
and  subsequently  a  greater  degree  of  association  with  the  TPCF. 


Conclusions 


In  conclusion  the  more  promising  estimator  of  electronic  maintenance  performance 
as  a  function  of  uncommonly  effective  and  uncommonly  ineffective  performance  incidents 
is  a  performance  estimator  similar  to  the  Weighted-Average  Reliability  Estimate  (WRE). 

This  conclusion  is  made  under  the  assumption  that  composite  reliability  values  are 
employed  in  those  job  activities  in  which  a  man  does  not  work  at  or  received  ZUE  =  ZUI  =  0. 
However,  even  this  estimator  cannot  be  recommended  for  general  use  within  the  U.  S.  Navy 
at  the  present  time.  Only  in  the  EM,  ET,  FT,  and  IC  ratings  is  its  use  presently  war¬ 
ranted,  while  application  in  the  RM,  ST,  and  TM  ratings  is  tenuous.  It  is  suggested 
that  before  this  estimator  is  employed  in  other  ratings  that  the  appropriate  job  task 
analysis  and  isolation  of  job  activity  factors  be  completed  before  a  validation  effort 
is  attempted  in  that  rating,  perhaps  similar  to  the  procedures  conducted  in  this  report. 
That  it  is  necessary  to  perform  a  validation  effort  was  illustrated  in  this  research 
effort  by  the  results  obtained  in  the  RD  rating.  It  would  seem  that  it  is  too  much  to 
assume  that  the  technique  can  be  automatically  applied  to  other  ratings  with  even 
similar  job  activities. 


46 


Finally,  the  results  of  this  research  effort  do  demonstrate  that  the  performance 
measurement  technique  being  researched  does  have  a  large  degree  of  potential  for  practical 
application  on  specific  ratings  within  the  U.  S.  Navy.  In  particular,  the  detailed 
analyses  of  the  Technical  Proficiency  Checkout  Form  (TPCF)  demonstrated  the  potential 
of  that  Instrument  to  Isolate  job  tasks  which  may  require  further  training  on  the  part  of 
some  technicians.  Likewise  the  Job  Performance  Questionnaire  can  also  be  employed  to 
Isolate  those  Individuals  of  potential  detrimental  performance  levels  in  terms  of  ex¬ 
cessive  uncommonly  Ineffective  Incidents  of  performance.  Even  though  such  Instruments 
are  completed  by  the  technician's  Immediate  supervisor,  as  opposed  to  an  unbiased  eval¬ 
uator,  those  positive  qualities  of  the  performance  measurement  Instruments  can  prove  to 
be  most  valuable  even  If  one  Is  not  Interested  In  deriving  an  estimate  of  the  probability 
of  effective  performance  for  the  technician  evaluated.  Therefore,  short  of  a  procedure 
which  allows  for  a  completely  unbiased  evaluator,  the  technique  must  be  given  credit  for 
being  perhaps  the  most  viable  performance  measurement  technique  presently  available  and 
of  being  of  greatest  potentltal  value  to  the  U.  S.  Navy. 
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APPENDIX  A 


PERFORMANCE  EVALUATION  INSTRUMENTS 


A-l 
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A-2 


JOB  PERFORMANCE  QUESTIONNAIRE 


Name  of  Supervisor 


Rating 


Ship  or  Unit 


Instructions  to  Supervisor.  The  purpose  of  this  form  is  to  determine  the 
number  of  effective  and  ineffective  performances  you  have  observed  among  your 
men  during  the  oast  two  months.  We  are  only  interested  in  the  uncommonly  ef¬ 
fect  Ive  and  the  uncommon  I  y  i  ne  f  f  ect  i  ue  performances. 

List  below  the  names  of  all  the  men  under  your  supervision  who  are  currently 
striking  for,  orinany  of  the  following  ratings:  DS,  EM,  ET,  FT,  IC,  MT,  RD,  RM, 
ST,  TD,  TM  (AE,  AT,  AQ,  AX).  If  you  supervise  more  than  one  of  these  ratings, 

.  please  use  a  separate  form  for  each  rating. 

Now,  considering  the  fleet  electronic  maintenance  objectives,  enter  your  estimate 
ox  the  number  of  uncommonly  effective  (UE)  and  uncommonly  ineffective  (UI)  per¬ 
formances  during  the  past  two  months  for  each  man  being  rated.  Please  refer  to  the 
definitions  lists  for  the  meanings  of  the  JOB  ACTIVITIES  and  of  the  OBJECTIVES 
involved. 

The  first  line  has  been  filled  in  as  an  example.  The  supervisor  completing  the 
example  felt  that  Peter  Smith  had  ten  unusually  effective  performances  and  two 
'  unusually  ineffective  performances  while  performing  E  I  ec  t  r  on  i  c  Circuit  Ana  I - 

ses  when  considered  against  the  objectives  of  fleet  electronic  maintenance.  He 
also  felt  that  Smith  showed  two  uncommonly  effective  performances  in  the  area  of 
Electrosafety  and  four  uncommonly  ineffective  performances  in  Instruction. 

If  a  man  has  not  had  an  opportunity  to  perform  in  a  particular  area,  enter  a  dash(-); 
if  he  has  had  an  opportunity  but  has  not  shown  any  uncommonly  effective  or  ineffec¬ 
tive  performances,  enter  a  zero  (0). 


TECH  IH  GA  L  FRO  FT  C  T  E  NO  Y’  -  OH  E  0  ft  0  U  T  FORM 

NAME  OF  SUPERVISOR  RATING/RATE 

FULL  NAME  OF  MAN  EVALUATED 

SHIP  OR  UNIT  _ LOCATION  DATE 


TASK  DESCRIPTION 


CHECKED 

OUT 


NOT 

CHECKED 

OUT 


1.  Capable  of  employing  safety  precautions  on  most 
of  this  unit’s  equipment  with  which  his  rating 
is  concerned. 

2.  Capable  of  replacing  most  of  this  unit’s  equip¬ 
ment  with  which  his  rating  is  concerned, . 

3.  Capable  of  removing  most  of  this  unit’s  equip¬ 
ment  with  which  his  rating  is  concerned. 

4.  Capable  of  following  block  diagrams  for  most  of 
this  unit's  equipment  with  which  his  rating  is 
concerned. 

5.  Capable  of  knowing  relationship  of  equipment  to 
otherrelatecl  equipment  with  which  his  rating 
is  concerned. 

6.  Capable  of  calibrating  most  of  this  unit's  equip¬ 
ment  with  which  his  rating  is  concerned. 

7.  Capable  of  trouble-shooting/isolated  mal- 
function(s)  in  most  of  this  unit’s  equipment 
with  which  his  rating  is  concerned. 

8.  Capable  of  employing  electronic  principles 
involved  in  maintenance  of  most  of  this  unit’s 
equipment  with  which  his  rating  is  concerned. 


□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

MAKE  CERTAIN  THERE  IS  AN  "X"  IN  A  BOX  OPPOSITE  EACH  TASK  DESCRIPTION 


s_  . 

0)  VO 
5-  2  .it 
03  (/)  s_  • 

S  c  io-o 
«/>  <0  E  <D 
c  -*-> 
ro  <U  >,  (O 

1/1  (13  3  _ 

0)  fO  i-  r—  I  •  O  10  03 

.c  s-  4->  m  Iiolu+j  s-  <— 
•m  <u  io  > 

<u 

c  >,  >, 

d)r-  C  Ol 
t  18  C 
(J  «  -I- 

I  IB  0)  0)  0) 

;  ( —  p-  co  xo 
icou  8 
•  S-  e 

■  LlJ  IO 

)  .  .  £ 

J  >,  >. 

:  i—  i—  •  qj 
i  c  iv  aj£ 
i  O  +J  C73-M 
03  C 

i —  ( —  id  (/) 

•(-  CL  -C  -r- 

U  E  O 
CO 

03  u  oz 
CL  4->  <C 


Mr-  -UU 
=W-  CD  C  ■— ( 

c  ta  -z. 

id  io  S: 

4-3 ..  O 
03  U  3  UJ 
VI  03  OH 
=>*->>- 


0!fOO'SCMH«lA'H'nJijHafi0P(O'f<ffl+3  3  >  >  X  >>  bJ 
Jl  oti  OI'h  aCOfto'hlllP  3  l>  >  X  >>M 

aJfou'da3<MhO^!'H  t>X  H  0  fi  O  P<  o1^  M3  a  >  >  X  S  n 

c8,QO'C(a)3iHh033<H  n^l  H0  SOftt^hUMJ  3  !>  !*  X  >>  N 

aj  ,o  otJ  a»  tL-i  bO-C-H  -s,X  HSCOP<o<ftitn-P  3>  >  X>iN 
8fOtJT)O)^Bi:'H'n>!H0(!OftC3lJ(Jl43  3  >  >  X  >»  N 

ciBO'dOJ'HBfl'HTjAiHBCOfttfftdl+J  3  >  >  X  >»  N 

aJfoc3'd03<H  bDX-H  -oAO  HSCOftc^htn-p  3  >  >  X  >»  n 

'  I;  .•  !  I-  •  .  i  ;  I-  ■;  •;  ]’  .■  .j  ” 

aJ^OTJaM^bOrC-H-j^O^StsOftc^^ro-p  3  >  >  X  >>  N 

B^tlTj8lHliX(HnXH0GOftOlmMJ  3  >  >  X  >»  N 

:  ;  .•!!*!  •  .»  i  •  ! 

.  .  ‘  L, 

,0  O  'd  0)<H  fia  o  ft  O1  ^  W  -P  3  >  >  XXN 

cd  P  u  rtf  Q)«h  bDfj-H  6  a  O^c^^co-P  3  >  >  X  >>  cs» 


o  ^Nrtd-irtuJNcom 


OHNWj-iniDNCOO' 


o  h  n  m  j  in  vd  N  a)  o> 

(0  • 

•r* 

ci 

X  o  -Hcsjmj-LD  vo  h*.  co  cn 


o  h  cm  «  ^  in  us  n  co  o> 

j  ]  •  |] 

o  h  cm  ro  j  in  id  h*  co  c> 

o  H  m  w  j-  lO  id  h*  co  cr> 

.  ;  .  »* 

OrHfMcnj'ini.DNCD  o 


/  /  X  / 


DESCRIPTION  OF  JOB  ACTIVITIES 


JOB  ACTIVITY 


DESCRIPTION 


1.  Using  Reference  Materials — includes  the  following  type  of  activities: 

a.  use  of  supporting  reference'  materials 

b.  making  out  reports 

2.  Equipment  Operation — includes  the  following  type  of  activity: 

a.  operating  equipment,  electrical  and 
electronics  test  equipment,  and 
other  electronic  equipments 

3.  Electronic  Circuit  Analysis — includes  the  following  type  of  activities 

a.  understanding  the  principles  of 
electronic  circuitry 

b.  making  out  failure  reports 

c.  keeping  records  of  maintenance 
usage  data 

4.  Personnel  Relationships — includes  the  following  type  of  activity: 

a.  supervising  the  operation,  inspection, 
and  maintenance  of  electronic  equip¬ 
ments 

5.  Electro-safety — includes  the  following  type  of  activity: 

a.  using  safety  precautions  on  self  and 
equipment 

6.  Instruction- — includes  the  following  type  of  activity: 

a.  teaching  others  how  to  inspect, 
operate,  and  maintain  electronic 
equ ipments 

7.  Electro-repair — includes  the  following  type  of  activity: 

a.  equipment  repair  in  the  shop 

8.  Electro-cognition — includes  the  following  type  of  activities: 

a.  maintenance  and  troubleshooting  of 
electronic  equipments 

b.  use  of  electronic  maintenance 
reference  materials 
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MEANINGS  OF  FLEET  ELECTRONICS  MAINTENANCE  OBJECTIVES 


1 .  Readiness 

To  maintain  efficiently  self,  subordinate  personnel,  equipment, 
and  systems  in  state  of  readiness  consistent  with  fleet  requirements. 

2.  Performance 

To  complete  any  given  mission  in  minimum  time  with  appropriate 
level  of  accuracy  and  reliability. 

3.  Operation 

To  obtain  optimum  system  output  when  equipment  is  operated,  i.e., 
output  characterized  by  precision  and  variability  appropriate  to  mission. 

4.  Safety 

To  carry  out  duties  with  maximum  protection  for  men  and  equip¬ 
ment  consistent  with  mission. 

5.  Preparation 

To  prepare  for  personnel  requirements  of  present  and  future  equip¬ 
ment,  systems,  and  situations  through  use  of  training  programs,  maintenance 
of  high  morale,  etc. 


APPENDIX  B 

DATA  COLLECTION  PROCEDURES 


THIS  PAGE  IS  BLANK 
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PROCEDURE  EMPLOYED  IN  DATA  COLLECTION 


The  data  collection  effort  originated  by  requesting  of  CINCPACFLT 
and  CINCLANTFLT  that  ships  (Destroyer-type  vessels)  and  men  (in  the 
electronic  maintenance  ratings  -  EM,  ET,  FT,  IC,  RD,  RM,  ST,  and  TM) 
be  considered  for  participation  in  this  project.  It  was  requested  that 
initially  a  project  coordinator  at  an  appropriate  fleet  command  be 
assigned  in  order  to  coordinate  the  efforts  of  the  project  researchers 
from  NAVPERSRANDLAB  and  ship  liaison  officers.  Favorable  response  from 
both  fleet  commands  resulted  in  the  assignment  of  the  following  project 
coordinators : 


LCDR  G.  N.  Dunne 
Flag  Secretary 

Cruiser-Destroyer  Flotilla  Nine 
FPO  San  Francisco,  CA  96601 
(located  at  the  U.S.  Naval 
Station,  San  Diego,  CA) 


RDCS  C.  J.  Masterson 
COMCRUDESLANT  Staff 
CRUDE SLANT FLT 
FPO  New  York,  N.  Y. 
(located  at  the  U.S.  Naval 
Station,  Newport,  RI) 


The  duties  and  responsibilities  of  the  project  coordinator  may  be 
outlined  as: 


1.  identifying  the  ships  available  for  participating 
in  the  project. 

2.  seeking  the  assignment  of  a  liaison  officer  (usually 
the  senior  electronics  materials  officer)  aboard  each 
available  ship  to  coordinate  the  data  collection  aboard 
that  ship. 

3.  scheduling  the  meetings  between  the  ship  liaison  officers 
and  the  project  researchers. 

4.  making  appropriate  checks  on  the  progress  of  the  data 
collection  effort  aboard  each  ship. 

5.  collection  and  reviewing  for  completeness  of  the  data 
forms  before  mailing  all  forms  to  NAVPERSRANDLAB. 

Once  the  project  researchers  had  established  thec ships  and  liaison 
officers  of  those  ships  that  were  participating  in  the  project,  an  initial 
meeting  was  arranged  between  the  ship  liaison  officers  and  the  project 
researchers.  At  this  meeting  the  researchers  explained  the  purpose  of 
the  project  and  outlined  the  duties  and  responsibilities  of  a  ship  liaison 
officer  for  completing  the  data  collection  effort  aboard  his  ship.  It 
was  emphasized  that  it  would  be  the  ship  liaison  officers  responsibility 
to  perform  all  phases  of  the  data  collection  effort  aboard  ship. 
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Each  liaison  officer  was  given  a  set  of  instructions  (Appendix  C) 
which  outlines  in  detail  the  steps  he  was  to  perform  in  order  to  complete 
the  data  collection  effort  aboard  his  ship.  Essentially  it  was  required 
that  the  liaison  officer  select  immediate  supervisors  of  men  involved  in 
electronic  maintenance  activities  in  the  EM,  ET,  FT,  IC,  RD,  RM,  ST,  and 
TM  ratings  who  may  participate  in  the  project.  Each  liaison  officer  was 
also  given  a  set  of  Roster  Forms  (a  sample  of  a  Roster  Form  can  be  found 
in  Appendix  C,  page  C-8).  One  Roster  Form  was  completed  by  the  liaison 
officer  for  each  supervisor  participating  in  the  project  and  it  includes 
a  list  of  the  men  the  supervisor  is  to  evaluate.  A  technician  occurred 
on  this  list  if  that  supervisor  had  been  his  immediate  supervisor  for  at 
least  the  past  two  months,  length  of  the  evaluation  period,  and  the  techni¬ 
cian  at  that  time  was  at  most  a  petty  officer  second  class  in  one  of  the 
aforementioned  ratings.  In  order  to  achieve  the  most  reliable  information 
and  not  to  place  too  much  of  a  burden  on  any  one  supervisor,  the  supervisor 

was  limited  to  evaluating  no  more  than  seven  men  -  the  seven,  or  less  men, 

he  would  be  most  knowledgable  about  with  respect  to  their  on-the-job 
performance. 

At  the  second  and  final  meeting,  the  Roster  Forms  were  returned  to 

the  project  researchers  who  gave  a  Xerox  copy  of  these  forms  to  the  ship 

liaison  officer  and  the  project  coordinator.  Using  the  Roster  Forms  the 
project  researchers  completed  packages  of  Performance  Evaluation  Forms, 
one  such  package  for  each  supervisor.  Each  package  contained  a  set  of 
Instructions  for  the  Supervisor  for  Completing  Performance  Forms  (Appendix  D) , 
a  Xerox  copy  of  the  appropriate  Roster  Form  listing  the  men  that  the  super¬ 
visor  is  to  evaluate,  and  the  appropriate  number  of  sets  of  Performance 
Evaluation  Forms  (discussed  in  the  section,  Data  Collection  Instruments), 
one  set  for  each  technician  the  supervisor  was  to  evaluate. 

Upon  returning  to  his  ship,  the  liaison  officer  held  a  meeting  with 
the  supervisors  to  explain  the  purpose  of  the  project  and  to  describe  how 
they  were  to  complete  the  sets  of  Performance  Evaluation  Forms.  Once  the 
supervisors  had  completed  their  evaluations,  the  liaison  officer  submitted 
all  forms  to  the  Administrative  Officer  aboard  his  ship  who  provided  the 
additional  demographic  information  on  the  men  evaluated.  After  this  exer¬ 
cise  the  ship  liaison  officer  returned  all  forms  to  the  project  coordinator. 
The  project  coordinator,  once  he  received  the  completed  forms  from  all  the 
ships,  mailed  all  forms  to  NAVPERSRANDLAB. 
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APPENDIX  C 

INSTRUCTIONS  FOR 
SHIP  LIAISON  OFFICER 


NOTE:  The  instructions  on  pages  C-3  thru  C-12 
(pages  -1  thru  -5  of  the  text  of  the  in¬ 
structions  and  pages  -1  and  -1  thru  -4 
for  enclosures  (1)  and  (2)  respectively) 
of  this  report  are  paginated  for  publica¬ 
tion.  For  economy  of  reproduction,  the 
page  numbers  were  not  changed  for  this 
report. 
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NAVAL  PERSONNEL  RESEARCH  AND  DEVELOPMENT  LABORATORY 
Washington,  D.  C. 


Performance  Evaluation  Measures  > 
Information  to  Ship  Liaison  Officers 


Background 


The  general  purpose  of  the  present  study  is  to  further  investigate 
an  economical  and  practical  method  for  providing  feedback  information 
regarding  the  readiness  of  Naval  electronically  oriented  technical  per¬ 
sonnel  (specifically  EM,  ET,  FT,  IC,  RD,  RM,  ST,  and  TM  ratings)  for 
completing  their  assigned  mission.  Essentially,  a  result  of  the  study 
may  include  the  application  of  a  performance  evaluative  technique  which 
will  allow  continuous  and  quantitative  answers  to  questions  such  as: 

What  is  the  current  level  of  effectiveness  of  the  maintenance  personnel 
in  a  given  rating,  ship,  or  squadron?  IIow  does  the  maintenance  personnel 
effectiveness  level  of  a  given  rating,  ship,  or  squadron  compare  with 
that  of  other  ratings,  ships,  or  squadrons? 

In  a  previous  Office  of  Naval  Research  study,  a  unique  performance 
measurement  technique  was  developed  which  the  Naval  Personnel  Research 
and  Development  Laboratory  is  now  concerned  with  replicating  in  order  to 
establish  its  validity  and  to  determine  the  practicality  of  this  concept. 
Basically,  eight  dimensions  of  the  electronics  maintenance  ratings  were 
defined:  (1)  using  reference  materials,  (2)  equipment  operation,  (3) 

electronic  circuit  analysis,  (4)  personnel  relationships,  (5)  electro¬ 
safety,  (6)  instruction,  (7)  electro-repair,  and,  (8)  electro-cognition. 
On  the  basis  of  a  supervisor  observing  his  men  performing  on  the  job, 
he  indicates  the  number  of  times  that  he  saw  unusually  effective  or 
unusually  ineffective  performance  demonstrated  on  each  of  the  eight  job 
dimensions.  Based  upon  the  estimates  of  unusually  effective/ ineffective 
behavior,  meaningful  measures  of  technician  effectiveness  can  be  estab¬ 
lished.  Further,  the  individual  technician  effectiveness  values  can 
be  further  treated  to  form  effectiveness  indices  for  ratings,  ships, 
and  squadrons. 

Because  this  effort  is  primarily  concerned  with  replicating  a  prior 
study,  any  information  provided  by  ship  personnel  will  be  used  only  for 
research  purposes  by  the  Naval  Personnel  Research  and  Development  Lab¬ 
oratory  and  only  to  serve  as  a  statistical  data  base  for  validating  the 
results  of  that  prior  study.  Furthermore,  any  comparisons  made  between 
ratings,  ships,  or  squadrons  will  be  used  only  for  research  purposes. 


Suggested  Ship  Liaison  Officer  Assistance  Plan 


The  steps  outlined  below  are  those  as  envisioned  by  the  project 
researchers  which  you  may  execute  in  order  to  insure  an  efficient  data 
collection  effort  aboard  your  ship. 

Completion  of  the  Roster  Forms 

Either  a  project  researcher  or  the  project  coordinator  at  CRTJDESLANT 
has  given  you  a  set  of  Roster  Forms  (enclosure  (1)).  To  complete  the 
Roster  Forms  you  are  to  select  men  involved  in  electronic  maintenance 
activities' in  the  EM.  ET,  FT.  IC.  RD.  RM.  ST.  and  TM  ratings  and  immediate 
supervisors  of  those  men  aboard  your  ship.  Generally  the  men  being 
evaluated  will  be  petty  officers  second  class  and  below.  The  supervisors 
may  be  either  enlisted  personnel  or  officers  but  must  be  the  immediate- 
supervisors  of  the  men  they  are  to  evaluate.  They  should  have  knov;n  the 
men  they  are  evaluating  for  at  least  the  past  two  months.  Not  all  super¬ 
visors  of  men  in  the  previously  mentioned  ratings  will  qualify  for  partic¬ 
ipation  in  this  project*  however,  it  is  desired  that  all  individuals  in 
the  above  ratings  participate.  Once  you  have  completed  the  Roster  Forms, 
go  to  each  supervisor  to  participate  in  this  project  and  have  him  verify 
that  he  is  the  immediate  supervisor  of  the  men  that  you  have  selected  for 
him  on  the  respective  Roster  Form. 

Once  the  Roster  Forms  have  been  verified  by  the  supervisors,  send  a 
copy  of  these  forms  to: 


Mr.  Bernard  Rafacz 
Naval  Personnel  Research 
and  Development  Laboratory 
Room  3315,  Bldg.  200 
Washington  Navy  Yard 
Washington,  D.  C.  20390 

He  is  your  contact  man  at  the  Naval  Personnel  Research  and  Development 
Laboratory.  If  you  have  any  problems  or  questions  concerned  with  the 
implementation  of  the  instructions,  it  may  be  possible  for  you  to  contact 
him  (AUTOVON  288-4457)  or  the  project  coordinator. 


He  will  prepare  the  packages,  of  Performance  Evaluation  Forms  for 
mailing  to  you.  One  such  package  is  a  blue  folder  containing  a  set  of 
Instructions  to  the  Supervisor  on  the  left  inside  cover  and  sets  of 
performance  evaluation  forms  on  the  right.  On  the  front  of  each  package 
is  a  label  with  the  name  of  the  supervisor  who  is  to  complete  the  sets 
of  performance  evaluation  forms  contained  therein  on  the  men  for  whom 
he  is  their  immediate  supervisor. 
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Briefing  Each  Supervisor 


Once  you  have  received  the  Packages  of  Performance  Evaluation  Forms 
from  the  Naval  Personnel  Research  and  Development  Laboratory,  you  are 
now  ready  to  distribute  these  forms  to  the  supervisors  participating  in 
this  project.  This  may  be  done  in  one  of  two  ways:  1)  calling  a  meeting 
of  all  supervisors  so  that  you  may  distribute  the  packages  and  brief  them 
as  to  their  responsibilities  all  at  one  time,  or,  2)  meet  individually 
with  each  supervisor  and  instruct  him  on  a  personal  basis  as  to  his 
responsibilities  in  completing  the  experimental  forms. 

It  is  your  choice  as  to  which  procedure  to  follow,  however,  for  ships 
with  only  several  supervisors  participating,  the  latter  method  may  be  the 
most  convenient. 

When  meeting  with  the  supervisor  you  should  instruct  him  on  the  same 
subject  material  as  you  i-7ere  originally  briefed  either  by  the  project 
researcher  or  the  project  coordinator  at  CRUDESLANT.  In  particular, 
you  should  guide  the  supervisor  through  his  set  of  Instructions,  going 
over  the  three  SAMPLE  pages  of  performance  evaluation  forms.  Important 
things  to  mention  to  the  supervisor  about  the  three  forms  in  each  set  of 
Performance  Evaluation  Forms  are  outlined  below. 

1.  The  Personnel  Identification  Information  Form  (PIIF) 

The  purpose  of  this  form  is  to  provide  various  background 
information  on  the  man  being  evaluated.  The  supervisors  should 
first  of  all  supply  the  information  at  the  top  of  this  form.  Only 
the  background  information  to  the  right  of  the  cross-hatched  area 
is  to  be  supplied  by  the  supervisor.  Please  tell  him  that  he  must 
do  this  to  facilitate  the  job  of  the  Administrative  Officer  aboard 
his  ship.  Because  he  is  normally  in  everyday  contact  with  the  men 
he  is  evaluating,  it  should  not  be  too  difficult  to  obtain  this 
information  directly  from  the  man  being  evaluated.  The  information 
to  the  left  of  the  cross-hatched  area  wil-l  be  supplied  by  the 
Administrative  Officer  aboard  your  ship  and  so  the  supervisor 
should  not  concern  himself  with  this  section  of  the  PIIF.  If  for 
some  reason  he  cannot  obtain  some  of  the  background  information 
from  the  man  being  evaluated,  please  have  the  Administrative 
Officer  supply  this  information  at  a  later  date.  Particular 
instructions  for  completing  this  form  are  given  in  the  Supervisor's 
Instruction  Package.  Please  be  sure  that  he  understands  these 
instructions  and  the  correct  procedure  for  entering  the  requested 
information  on  the  blank  PIIF  Op-Scan  Sheet  in  each  set  of 
experimental  forms. 
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2.  The  Technical  Proficiency  Checkout  Form  (TPCF) 

This  form  is  designed  to  estimate  the  level  of  technical  com¬ 
plexity  at  which  a  man  is  able  to  work  without  direct  supervision. 

The  supervisor  should  provide  the  information  at  the  top  of  the 
TPCF.  The  eight  task  descriptions  are  listed  in  ascending  order 
of  difficulty  with  task  No.  8  identified  as  the  most  difficult 
task.  The  supervisor  is  simply  to  record  an  "X"  in  the  CHECKED  OUT 
box  for  each  task  which  he  feels  the  ratee  is  capable  of  performing 
"on  his  own  without  direct  supervision."  Otherwise  he  should 
record  an  "X"  in  the  NOT  CHECKED  OUT  box.  The  supervisor  must  be 
certain  there  is  an  "X"  in  a  box  opposite  each  task  description. 

3.  The  Job  Performance  Questionnaire  (JPQ)  ANSWER  SHEET 

The  JPQ  ANSWER  SHEET  is  undoubtedly  the  most  difficult  form  we 
are  asking  the  supervisor  to  complete.  However,  the  researchers 
have  tried  to  facilitate  the  understanding  of  what  information  is 
requested  by  giving  explicit  samples  to  each  question  to  be  answered. 
In  particular  the  JPQ  ANSWER  SHEET  records  estimates  of  the  total 
number  of  uncommonly  effective  (UE)  and  uncommonly  ineffective  (Ul) 
incidents  of  performance  the  supervisor  has  observed  over  a  prior 
two  month  period  on  the  man  being  evaluated.  Read  page  7  of  the 
Supervisor's  Instructions  aloud  to  every  supervisor  and  be  sure 
that  he  understands  what  he  is  expected  to  record  on  the  JPQ  ANSWER 
SHEET.  At  the  top  of  page  9  is  a  definition  of  what  is  generally 
meant  as  an  uncommonly  effective  or  uncommonly  ineffective  per¬ 
formance.  However,  the  supervisor  should  not  adhere  strictly  to 
this  definition.  He  would  best  know  for  his  particular  working 
area  what  such  performances  are.  He  should  use  the  researchers 
definition  only  as  a  guide  to  conceptualize  upon  the  extremes  of 
performance. 

Page  13  of  the  Supervisor's  Instructions  is  a  SAMPLE  of  a  JPQ 
ANSWER  SHEET  found  in  each  set  of  performance  evaluation  forms. 

The  supervisor  must  review  the  table  on  page  9  together  with  the 
sample  in  order  to  understand  where  and  how  to  record  his  estimates 
of  the  total  number  of  UE  and  UI  incidents  of  performance  on  the 
JPQ  ANSWER  SHEET.  Please  review  this  table  with  him.  Also  remark 
on  the  NOTE  at  the  bottom  of  page  9. 

QUESTION  (c)  on  page  11  of  the  Supervisor's  Instructions  must 
be  answered  in  column  (c)  for  each  job  activity.  Please  point 
this  out  to  the  supervisor. 

Three  remaining  questions  given  on  pages  11  and  12  of  the 
Supervisor's  Instructions  are  to  be  answered  in  the  lower  corner 
provided  on  the  JPQ  ANSWER  SHEET.  Finally  the  supervisor  is  to 
place  his  social  security  account  number  in  the  space  provided 
on  each  JPQ  ANSWER  SHEET  he  completes. 
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Instruct  the  supervisor  that  he  will  have  approximately  one 
week  to  complete  all  forms  for  the  men  he  is  to  evaluate.  It  is 
important  that  he  realizes  that  the  Op-Scan  sheets  (the  PIIF  and 
JPQ  ANSWER  SHEET)  will  be  machine  processed  and  therefore  it  is 
essential  that  they  remain  as  much  in  their  original  condition 
as  is  possible.  Once  the  supervisor  completes  the  forms,  he  must 
return  them  to  you  in  the  original  folder,  as  you  submitted  them 
to  him.  You  should  review  the  forms  as  they  are  submitted  and 
check  that  all  of  the  information  that  is  requested  has  been 
provided.  Please  be  sure  that  each  form  of  each  set  contains  the 
supervisors  name  and  the  technician's  name  in  the  proper  locations. 

4.  Briefing  the  Administrative  Officer 

It  is  now  necessary  that  you  submit  all  packages  to  the 
Administrative  Officer  aboard  your  ship  in  order  that  the  Personal 
Identification  Information  Form  (PIIF)  be  completed  for  each  man 
evaluated.  Enclosure  (2)  is  a  set  of  Instructions  for  the 
Administrative  Officer.  You  will  have  to  request  his  assistance 
in  order  that  the  information  to  the  left  of  the  cross-hatched 
area  on  each  PIIF  be  completed.  All  of  this  information  may  be 
found  in  the  personnel  jacket  of  the  man  being  evaluated.  Com¬ 
plete  details  for  providing  this  information  are  contained  with¬ 
in  the  Instructions  to  the  Administrative  Officer.  To  insure 
that  the  forms  are  properly  completed,  you  should  review  these 
instructions  with  him. 

Once  the  Administrative  Officer  has  completed  all  the  PIIFs  and 
returned  all  packages  to  you,  from  each  set  of  Performance  Evaluation 
Forms  remove  the  paper  clip.  (For  Op-Scan  purposes  it  is  imperative 
that  the  forms  are  not  bent.)  All  completed  packages  and  any  extra 
forms  are  to  be  given  to  the  project  coordinator.  He  will  send  them 
back  to  Mr.  Rafacz  at  the  Naval  Personnel  Research  and  Development 
Laboratory. 
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SAMPLE 

ROSTER  FORM 

Name  of  Liaison  Officer  George  Merklin _  Date  £  an 

Ship _ ROAN _ _ _ Homeport  Location  Newport _ 


Immediate  Supervisor  Abner  Smith 

Rating/Rate  EMC 

Names  of  Men  to  be  Evaluated 

Tom  Henry  Jones 

Rating/Rate 

EM  3 

George  William  Klaok 

RMSN 

Robert  Larry  Lane 

ETN2 

eto. 

eto. 

Enclosure  (1) 


NAVAL  PERSONNEL  RESEARCH  AND  DEVELOPMENT  LABORATORY 
WASHINGTON,  D.C. 


Instructions  for  the  Administrative  Officer 
Completing  the  Personnel  Identification 
Information  Form  (PIIF) 


Recently  your  ship  and  some  supervisors  of  men  in  the  electronic  or 
related  ratings  -  EM,  FT,  ET,  IC,  RD,  RM,  ST,  TM  -  aboard  your  ship  have 
been  selected  to  participate  in  a  performance  evaluation  program  being 
conducted  by  the  Naval  Personnel  Research  and  Development  Laboratory. 

The  men  selected  are  immediate  supervisors  of  personnel  in  those  ratings. 
The  liaison  officer  aboard  your  ship  in  charge  of  coordinating  the  activ¬ 
ities  between  the  researchers  and  your  ship  for  this  program  has  given 
each  such  supervisor  a  package  of  materials  containing  a  Supervisor's 
Instruction  Package  and  sets  of  Performance  Evaluation  Forms;  one  set  for 
each  man  the  supervisor  is  evaluating.  Every  set  of  Performance  Evalua¬ 
tion  Forms  is  made  up  of  the  following  forms: 


1.  Personnel  Identification  Information  Form  (PIIF) 

2.  Technical  Proficiency  Checkout  Form  (TPCF) 

3.  Job  Performance  Questionnaire  (JPQ)  ANSWER  SHEET 


The  supervisor  will  complete  in  part  a  set  of  Performance  Evaluation 
Forms  for  each  man  he  is  evaluating.  Only  the  Personnel  Identification 
Information  Form  (PIIF)  found  in  each  set  is  to  be  completed  by  the  Admin¬ 
istrative  Officer.  In  essence,  this  form  records  various  background 
information  on  the  man  being  evaluated.  Once  the  supervisor  has  completed 
supplying  the  information  requested  on  the  set  of  Performance  Evaluation 
Forms,  he  will  return  them  to  the  liaison  officer  who  in  turn  will  give 
them  to  you,  the  Administrative  Officer,  in  order  that  the  PIIF  in  each 
set  be  completed.  For  each  PIIF  you  receive,  the  supervisor  was  to  have 
supplied  the  information  to  the  right  of  the  cross-hatched  area  on  this 
form.  The  first  thing  you  should  do  is  to  check  over  this  section  of  the 
form  and  see  that  all  of  the  following  information  was  provided  for  the 
man  being  evaluated: 


a. 

b. 

c. 

d. 

e. 

f. 
8- 


Technician's  Name 

"  Social  Security  Number 

"  Birthdate 

"  Months  Known  by  Supervisor 

"  Months  on  Current  Job  Assignment 

"  Months  of  Active  Duty  Service  (USN*  and  USNR**) 

"  Rating  and  Paygrade 


*Record  99  months  for  USN  if  the  Technician's  Months  of  USN  Active  Duty 
Service  equals  or  exceeds  99  months. 

**Record  99  months  for  USNR  if  the  Technician's  Months  of  USNR  Active  Duty 
Service  equals  or  exceeds  99,  months. 


Enclosure  (2) 


If  some  information  in  this  section  is  omitted,  please  provide  it. 

Use  only  a  #2  pencil  when  supplying  any  information  on  this  form.  To  aid 
you  in  completing  the  PIIFs,  page  4  of  these  instructions  contains  a  sample 
of  a  completed  PIIF.  From  this  sample  you  will  see  that  the  following 
information  is  obtained  from  the  section  of  the  form  to  the  right  of  the 
cross-hatched  area: 


1.  The  supervisor  is  EMC  Abner  Smith  located  at  Newport  aboard 
the  USS  ROAN  and  completed  this  form  on  7  January  1972. 

2.  This  supervisor  was  evaluating  EM3  Tom  Henry  Jones  whose  social 
security  account  number  is  123-45-6789  and  he  was  born  in 
March,  1948.  He  was  known  for  13  months  by  the  supervisor, 

and  had  been  15  months  on  his  current  job  assignment.  Jones 
had  served  no  USNR  active  duty  time  but  had  been  on  USN 
active  duty  for  29  months. 

One  you  have  reviewed  the  sample  on  page  4  for  that  section,  turn 
your  attention  to  the  section  of  the  PIIF  to  the  left  of  the  cross- 
hatched  area.  The  following  table  represents  all  of  the  information  for 
this  section  that  is  to  be  provided  by  you  from  the  service  record  for 
the  man  being  evaluated. 


Item 


Location  in  Service  Record 


I  A  School 
B  M 

C  " 

|  A 

Class  Standing  I  B  M 

[  C  " 


Class  Size 


A 

B 

C 


NAVPERS  601-4 


Years  of  Civilian  Education  (Yrs.  Ed.)  NAVPERS  601-3 

GCT  Score 
ARI  " 

MECH  " 

CLER  " 


If 

If 

VI 

II 


In  all  cases  the  most  recently  completed  A,  B,  or  C  school  information 
is  to  be  provided.  If  for  some  reason  a  technician  did  not  attend  some  of 
the  schools,  leave  that  section  of  the  PIIF  blank  for  that  school.  A 
Final  Mark  such  as  54.23  is  recorded  as  54.23  on  the  PIIF.  Final  Marks  of 
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the  form,  90,  82,  77,  etc.,  (i.e.,  two  digit  scores)  are  recorded  as 
90.00,  82.00,  77.00,  etc.,  respectively.  If  some  schools  gave  a  Final 
Mark  of  "satisfactory"  or  "unsatisfactory",  record  99.99  for  a  satisfactory 
Final  Mark  and  00.01  for  an  unsatisfactory  Final  Mark. 

Once  again  turn  to  page  4  of  these  instructions  which  contains  the 
previously  mentioned  sample  of  a  PIIF  and  to  the  section  to  the  left  of 
the  cross-hatched  area.  From  that  section  of  the  sample  form,  the  fol¬ 
lowing  table  represents  the  information  the  Administrative  Officer  aboard 
the  USS  ROAN  provided  on  EM3  Tom  Henry  Jones:. 


Item 


As  Recorded  in  Service  Record 


Final  Mark 


Class  Standing 


Class  Size" 


A  School 

77.86 

B  " 

(did  not  attend 

C  " 

90 

A  " 

57  th 

B  " 

- 

C  " 

26th 

A  " 

122 

B  " 

- 

C  " 

27 

Years  of  Civilian  Education  (Yrs.  Ed.) 


12 


GCT  Score 
ARI  " 
MECH  " 
CLER  " 


50 

49 

56 

47 


If  you  have  any  questions  regarding  the  type  or  the  recording  procedure 
of  any  of  the  desired  information,  please  consult  the  liaison  officer  for 
this  project.  Once  all  PIIFs  in  all  sets  of  Performance  Evaluations  Forms 
have  been  completed  by  you,  return  all  packages  to  the  liaison  officer. 

Thank  you  for  your  cooperation  and  efforts  in  completing  these  forms. 
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APPENDIX  D 

INSTRUCTIONS  FOR  SUPERVISOR 


NOTE:  The  instructions  on  pages  D-3  thru  D-15 
(pages  -1  thru  -13)  of  this  report  are 
paginated  for  publication.  For  economy 
of  reproduction,  the  page  numbers  were 
not  changed  for  this  report. 
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THIS  PAGE  IS  BLANK 
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NAVAL  PERSONNEL  RESEARCH  AND  DEVELOPMENT  LABORATORY 
WASHINGTON,  D.C.  . 


Instructions  for  the  Supervisor  for  Completing 
Performance  Evaluation  Forms 


You,  as  a  supervisor,  have  been  selected  to  participate  in  a  perform¬ 
ance  evaluation  program  being  conducted  by  the  Naval  Personnel  Research 
and  Development  Laboratory.  Performance  evaluation  in  the  U.S.  Navy  has 
served  as  a  guideline  for  the  optimal  positioning  of  manpower  and  for 
feedback  on  Naval  school  effectiveness.  It  is  felt  that  you  will  be  the 
most  qualified  to  give  accurate  and  meaningful  information  on  the  perform¬ 
ance  of  the  men  you  supervise.  For  that  reason  it  is  necessary  that  you 
make  an  earnest  effort  at  providing  the  information  requested  of  you. 
Without  your  support  and  honest  efforts,  the  time  and  funds  put  into  this 
research  endeavor  will  have  been  negated. 

You  are  asked  to  complete  a  set  of  three  performance  evaluation 
forms  for  each  petty  officer  and  designated  striker  -  in  the  EM,  ET,  FT, 
IC,  RD,  RM,  ST,  and  TM  ratings  only  -  over  whom  you  have  immediate 
supervision.  The  titles  and  descriptions  of  the  three  experimental 
forms  are: 

1.  Personnel  Identification  Information  Form  (PIIF)  -  this  form 
is  concerned  with  the  background  data  of  the  man  you  are  evaluating. 

You  will  complete  part  of  it  and  the  Administrative  Officer  aboard  your 
ship  will  supply  the  remaining  information. 

2.  Technical  Proficiency  Checkout  Form  (TPCF)  -  this  form  records 
the  level  of  technical  complexity  at  which  a  man  is  able  to  perform 
without  direct  supervision. 

3.  Job  Performance  Questionnaire  (JPQ)  ANSWER  SHEET  -  this  form 
records  your  estimates  of  the  number  of  a  man's  uncommonly  effective 
and  ineffective  performances  that  you  have  observed  during  a  specified 
time  period. 

From  your  ship's  liaison  officer,  who  is  coordinating  this  project, 
you  have  received  a  packet  of  materials  containing  these  instructions 
and  a  number  of  blank  copies  of  the  three  forms  just  described.  Ad¬ 
ditional  blank  forms  may  also  be  obtained  from  the  liaison  officer  if 
you  need  them.  Together,  these  forms  -  the  PIIF,  TPCF,  and  JPQ  ANSWER 
SHEET  -  constitute  a  full  set  of  Performance  Evaluation  Forms.  You 
are  to  fill  out  one  of  each  type  of  form  -  one  complete  set  of  three 
forms  -  for  each  man  whose  performance  you  evaluate.  You  will  have 
approximately  one  week  in  which  to  complete  the  sets  of  Performance 
Evaluation  Forms  for  all  the  men  who  have  been  designated  for  you  to 
evaluate.  Please  remember  to  use  only  a  #2  pencil  in  filling  out  the 
Performance  Evaluation  Forms, 


Turn  now  to  pages  4,  6,  and  13  of  these  instructions.  On  those 
pages  are  samples  of  the  three  Performance  Evaluation  Forms.  Notice 
that  each  of  the  three  sample  forms  is  preceded  by  a  page  of  instruc¬ 
tions.  These  particular  sample  forms  were  completed  for  the  following 
typical,  naval  situation. 

EMC  Abner  Smith  is  the  immediate  supervisor  of  seven  men 
aboard  the  USS  ROAN  located  at  Newport.  He  had  been  given 
seven  sets  of  Performance  Evaluation  Forms,  with  a  Super¬ 
visor's  Instruction  Package,  by  the  liaison  officer  aboard 
the  USS  ROAN.  During  the  week  of  7  January  1972,  he  com¬ 
pleted  all  Performance  Evaluation  Forms.  One  of  the  men 
he  evaluated  was  EM3  Tom  Henry  Jones.  The  samples  on 
pages  4,  6,  and  13  are  therefore  the  PIIF,  TPCF,  and  JPO  ANSWER 
SHEET  containing  information  on  EM3  Tom  Henry  Jones  furnished 
by  his  supervisor,  EMC  Abner  Smith. 

Before  starting  on  the  Performance  Evaluation  Forms,  study  the  samples 
that  are  included  in  these  instructions.  Please  do  not  let  your  answers 
be  influenced  by  the  information  given  on  the  sample  Performance  Evaluation 
Forms.  The  answers  given  on  the  sample  forms  are  meant  only  to  be  guides 
in  aiding  you  to  complete  your  forms  on  the  men  you  evaluate. 

All  responses  to  questions  are  completely  CONFIDENTIAL.  Any  in¬ 
formation  you  provide  will  be  used  only  by  the  researchers  of  the  Naval 
Personnel  Research  and  Development  Laboratory,  and  only  to  serve  as  a 
statistical  data  base  for  arriving  at  performance  estimates  of  enlisted 
naval  personnel  in  general. 

Your  help  and  cooperation  in  participating  in  this  project  are 
greatly  appreciated  by  the  project  researchers  at  the  Naval  Personnel 
Research  and  Development  Laboratory. 
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Instructions  for  Completing  the  PIIF 


The  Personnel  Identification  Information  Form  (PIIF)  records  various 
background  information  on  the  man  you  are  evaluating.  Refer  to  the  sample 
PIIF  on  page  4  of  these  Instructions  and  the  DIRECTIONS  given  there.  Note 
that  you  need  furnish  only  the  information  requested  to  the  right  of  the 
cross-hatched  area,  namely: 


Technician's  Name 

"  Social  Security  Number 

"  Birthdate 

"  Months  Known  by  Supervisor 

"  Months  on  Current  Job  Assignment 

"  Months  of  Active  Duty  Service  (USN*  and  USNR**) 

"  Rating  and  Pay grade 


It  is  understood  that  you  will  obtain  most  of  this  information  directly 
from  the  man  you  are  evaluating.  It  is  important  that  this  background 
information  be  as  accurate  as  is  possible.  If  you  doubt  the  accuracy  of 
any  of  the  information  you  have  obtained  from  the  technician,  or  if  you 
are  unable  to  obtain  it,  please  ask  the  Administrative  Officer  aboard  your 
ship  to  provide  you  with  the  correct  information.  In  addition,  you  as  the 
supervisor  will  also  fill  out  the  two  upper  left  lines  of  the  PIIF.  This 
includes  your  name,  rating  and  rate,  date,  ship  and  its  current  homeport 
location. 

From  the  sample  PIIF  on  page  4,  notice  that  the  following  information 
is  obtained: 

1.  The  supervisor  is  EMC  Abner  Smith  located  at  Newport  aboard  the 
USS  ROAN  and  completed  this  form  on  7  January  1972. 

2.  This  supervisor  was  evaluating  EM3  Tom  Henry  Jones  whose  social 
security  account  number  is  123-45-6789,  and  he  was  born  in  March,  1948. 

He  was  known  for  13  months  by  the  supervisor,  and  had  been  15  months  on 
his  current  job  assignment.  Jones  had  served  no  USNR  active  duty  time 
but  had  been  on  USN  active  duty  for  29  months. 


^Record  99  months  for  USN  if  the  Technician's  Months  of  USN  Active  Duty 
Service  equals  or  exceeds  99  months. 

**Record  99  months  for  USNR  active  time  if  the  Technician's  Months  of 
USNR  Active  Duty  Service  equals  or  exceeds  99  months. 


3 


at 

>  at 
at  > 
at  at  • 
►J  <u  o 


0) 

CO 

. 

cd 

u 

X 

4) 

> 

G 

cd 

T3 

cd 

o 

B 

a) 

CO 

cd 

B 

0) 

x: 

u 

x> 

cd 

a 

G 

4J 

a 

w 

g 

3 

(0 

0) 

>» 

cd 

2 

cd 

c 

0) 

cd 

0 

B 

4-J 

a) 

cd 

u 

pH 

• 

o 

CO 

<0 

rC 

u 

cd 

CO 

W 

4J 

u 

pH 

u 

Q) 

CO 

> 

cd 

2 

•H 

T3 

a) 

<5 

UH 

-G 

G 

Ps 

4J 

PS 

<0 

•H 

4) 

pH 

a 

too 

g 

+J 

CO 

a 

c 

cd 

G 

•H 

w 

u 

•H 

u 

«d 

•H 

Jh 

4) 

x: 

CO 

c/3 

cd 

a) 

4) 

a) 

CU 

52 

pH 

nH 

z 

pH 

H 

m 

X> 

<3 

4J 

x: 

o 

« 

a 

cd 

* 

M 

QJ 

c 

M 

u 

g 

> 

a 

G 

•H 

G 

H 

w 

cd 

o 

M 

O 

PH 

0) 

■  a)  S3  U  TS  jjlu  MXi'H  i->.X 

I 

-  cd  x>  u  t3  4)  <4h  oo  x:  *h 

'  cd  X>  u  T3  <U  Uh  ao  &  «H 

■Cd  ,0  OT3  a)  <4-1  toO  XI  «H  t-n^J 


o  •  • 

S>*  >* 

pH  pH 

M  d  <U 
Q  ou 
a) 


g  x>  ot3  aj  «4h  wjx;*H  -r-i^s  h  a  c  o  a  CT  M 

I 

W  S3  a  TS  a)  OH  HO  £  Tl  -I— lUai  rH0COQ.O,hl<O*J3>:*X>»N  U  OH  Nrt'J  UVOMOOt 

I  -  I 

at  jo  u  ts  at  un  cat  sc  -h  t-i^j  h  q  e  o  atrt<  nu9>)x>vN  «  o<-tcsir^<rm'£)r'0o<7> 

g  I 

at  S3  U  TS  atOH  M£  -H  1-14^  HQ  e  O  ftB'lt  »US>>X>iN  tH  OHNHl-T  1THO  N  CO  O 

,  1^1 

at  S3  a  TS  4JIM  M)S3  tH  -I— l£ai  H  Q  It  O  arh  tgU3>}X>.N  S3  O  H  N  PI  UVO  N  00  O 

I  s  I 

at  S3  u  ts  at  oh  aosc  -h  t->.x  h  g  c  o  acrt<  #u3>)x>,n _ OHtsw-»iri^)tsai0' 

s  >  y  7~z 

«  S3  u  ts  at  an  M£  h  i-i^  h  a  C  o  <3.  cr  h  »  u  a  >  5  x  >»  n 

i 

16,0  O  t3  nfw  M£-H-n^!  H  B  c  O  achnu3>$t(XN 


0  C  o  a  crti  omj  a  >  sx>aN  •  lOHNco-a  ithomooi 

* !  i 

0COa.<TtHW+J3>^X>,N  >,  lOHNnO’  UTvO  N  CO 

hi  I 

•H  I 

tH  ' 

0COao't<l»U3>)X>,N  3  Oi-tcsiro^-invor^oOON 

I  «  I 

on  • 

0coao,MBiu3>  5X>>n  ohn  co-a  loattHcoai 


>  3  uts  ato-i  tats:  -.h  -ttss  i-i  g 

I 

S3  U  TS  (UXH  O0S5  tH  T.X  rH  0 
S3  UTS  0)<4H  00  J=  *rl  - — ,  ^  I  0 


o>  X  hi 

at  o  at 


Coach 

Coach 

8 

c  o  ach 

i 

c  o  ach 


at  u  3  w 
at  at  O  H 

£3  hi 


S3  UTS  OtOH  OOJS-rll-lSlSrHB  Q  O  O.O’hl  C04J  3  >  J  X  >,  N 

I 

so  u  x>  at  an  oox:  hh  -os^  Hseoachics3>ax»'N 


hnit-c  irtio  rs  co  ci 
I  I  I  I  I  I  I  I  I 
WWWWWWWWW 


oU 


Instructions  for  Completing  the  TPCF 


A  sample  of  a  completed  Technical  Proficiency  Checkout  Form  is  shown 
on  page  6,  completed  by  EMC  Abner  Smith  for  EM3  Tom  Henry  Jones.  Eight 
tasks  are  listed  in  descending  order  of  difficulty.  It  is  felt  that  an 
individual's  overall  proficiency  is  directly  related  to  the  highest  level 
of  task  in  the  set  which  he  can  perform  without  direct  supervision. 

Beginning  with  task  description  NO.  1.  (Capable  of  employing  safety 
precautions  ...),  place  an  "X"  in  the  "CHECKED  OUT"  box  if  you  feel  that 
the  man  you  are  evaluating  is  capable  of  performing  the  task  on  his  own 
without  direct  supervision.  If  you  feel  he  is  not  able  to  perform  the 
task  on  his  own,  place  an  "X"  in  the  "NOT  CHECKED  OUT"  box.  Complete  this 
form  by  going  through  the  eight  tasks  described.  Be  sure  to  provide  the 
information  at  the  top  of  the  TPCF  form,  to  include  your  name,  rating  and 
rate,  full  name  of  the  man  evaluated,  ship  and  its  current  homeport 
location,  and  the  date.  Refer  to  the  sample  TPCF  given  on  page  6  of  these 
instructions.  You  will  notice  that  EMC  Abner  Smith  marked  EM3  Tom  Henry 
Jones,  as  being  "CHECKED  OUT"  on  tasks  1  through  6,  but  felt  that  he  was 
not  able  to  perform  tasks  7  and  8  without  direct  supervision. 
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SAMPLE 


TECHNICAL  PROFICIENCY 


CHECKOUT  FORM 


NAME  OF  SUPERVISOR  Abner  Smith _ RATING/RATE  EMC 


FULL  NAME  OF  MAN  EVALUATED _ Tom  Henry  Jones  _ 

SHIP  OR  UNIT  USS  ROAN _ LOCATION  Newport  _ DATE  7  Januaru  72 


TASK  DESCRIPTION 


NOT 

CHECKED  CHECKED 

OUT  OUT 


1.  Capable  of  employing  safety  precautions  on  most 
of  this  unit's  equipment  with  which  his  rating 
is  concerned. 


2.  Capable  of  replacing  most  of  this  unit's  equip¬ 
ment  with  which  his  rating  is  concerned. 


3.  Capable  of  removing  most  of  this  unit's  equip¬ 
ment  with  which  his  rating  is  concerned. 


4.  Capable  of  following  block  diagrams  for  most  of 
this  unit's  equipment  with  which  his  rating  is 
concerned. 


5.  Capable  of  knowing  relationship  of  equipment  to 
other  related  equipment  with  which  his  rating 
is  concerned. 


6.  Capable  of  calibrating  most  of  this  unit's  equip¬ 
ment  with  which  his  rating  is  concerned. 


7.  Capable  of  trouble-shooting/ isolated  mal- 

function(s)  in  most  of  this  unit's  equipment 
with  which,  his  rating  is  concerned. 


8.  Capable  of  employing  electronic  principles 

involved  in  maintenance  of  most  of  this  unit's 
equipment  with  which  his  rating  is  concerned. 


MAKE  CERTAIN  THERE  IS  AN  "X" 


IN  A  BOX  OPPOSITE  EACH  TASK  DESCRIPTION 
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Instructions  for  Completing  the  JPQ  ANSWER  SHEET 

The  purpose  of  the  Job  Performance  Questionnaire  (JPQ)  ANSWER  SHEET  is 
to  record,  for  a  given  individual,  your  estimates  of  the  total  number  of 
uncommonly  effective  and  uncommonly  ineffective  incidents  of  performance 
you  have  observed  during  the  last  two  months  on  each  of  eight  job  activities 
(see  page  8) . 

In  previous  efforts  at  evaluating  the  performance  of  an  individual, 
such  as  the  reports  of  Enlisted  Performance  Evaluation,  you  mentally  "aver¬ 
aged"  your  observations  of  excellent  and  poor  incidents  of  performance  for 
that  man  in  order  to  arrive  at  an  overall  performance  estimate.  However, 
in  this  project  we  are  asking  you  to  focus  your  attention  on  only  the 
extremes  of  performance  —  uncommonly  effective  and  uncommonly  ineffective 
performances.  In  addition,  we  want  you  to  disregard  an  individual’s  over¬ 
all  performance  and  to  record  for  each  of  the  eight  job  activities  the 
total  number  of  times  you  have  observed  the  occurrence  of  uncommonly 
effective  and  uncommonly  ineffective  incidents  of  performance. 

As  a  general  example,  on  a  particular  day  a  man  has  demonstrated  two 
incidents  of  uncommonly  effective  performance  while  involved  in  the  job 
activity  Equipment  Operation  and  no  incident  of  uncommonly  ineffective 
behavior  for  that  job  activity  on  that  day.  Sometime  later,  on  perhaps 
another  day,  he  has  demonstrated  one  uncommonly  effective  performance  and 
one  uncommonly  ineffective  performance  for  the  job  activity  Equipment 
Operation.  If  in  the  past  two  months  no  other  of  his  duties  involved 
Equipment  Operation,  then  your  estimate  of  the  total  number  of  uncommonly 
effective  and  uncommonly  ineffective  incidents  of  performance,  for  that 
job  activity,  is  three  uncommonly  effective  and  one  uncommonly  ineffective 
incident  of  performance. 

In  order  to  determine  exactly  what  specific  types  of  activities  you 
should  consider  in  estimating  whether  the  man  has  shown  an  "uncommonly 
effective"  or  an  "uncommonly  ineffective"  performance,  refer  to  the 
DESCRIPTION  of  that  JOB  ACTIVITY  as  given  in  the  following  list: 
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DESCRIPTION  OF  JOB  ACTIVITIES 

JOB  ACTIVITY  DESCRIPTION 


1.  Using  Reference  Materials — includes  the  following  type  of  activities: 

a.  use  of  supporting  reference  materials 

b.  making  out  reports 

2.  Equipment  Operation — includes  the  following  type  of  activity: 


a.  operating  equipment,  electrical  and 
electronics  test  equipment,  and 
other  electronic  equipments 

3.  Electronic  Circuit  Analysis — includes  the  following  type  of  activities 

a.  understanding  the  principles  of 
electronic  circuitry 

b.  making  out  failure  reports 

c.  keeping  records  of  maintenance 
usage  data 

4.  Personnel  Relationships — includes  the  following  type  of  activity: 

a.  supervising  the  operation,  inspection, 
and  maintenance  of  electronic  equip¬ 
ments 

5.  Electro-safety — includes  the  following  type  of  activity: 

a.  using  safety  precautions  on  self  and 
equipment 

6.  Instruction- — includes  the  following  type  of  activity: 

a.  teaching  others  how  to  inspect, 
operate,  and  maintain  electronic 
equipments 

7.  Elec tro-r epair — includes  the  following  type  of  activity: 

a.  equipment,  repair  in  the  shop 

8.  Electro-cognition — includes  the  following  type  of  activities: 

a.  maintenance  and  troubleshooting  of 
electronic  equipments 

b.  use  of  electronic  maintenance 
reference  materials 
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Because  you  are  the  most  knowledgeable  of  the  area  you  supervise,  you 
will  know  what  incidents  of  performance  can  be  labeled  as  uncommonly  effec¬ 
tive  or  uncommonly  ineffective.  It. is  your  standard  that  is  to  be  used 
for  this  trial.  However,  to  further  assist  you  the  researchers  have  pro¬ 
vided  the  following  general  definitions. 

An  uncommonly  effective  performance  in  a  specific  job  activity  is  an 
impressive  and/or  decisive  incident  of  performance  qualitatively  above 
those  usually  observed.  Likewise,  an  uncommonly  ineffective  performance 
in  a  specific  job  activity  is  an  impressive  and/or  decisive  incident  of 
performance  qualitatively  below  those  usually  observed. 

With  this  in  mind,  turn  to  the  sample  of  a  JPQ  ANSWER  SHEET  on  page  13. 
Under  each  JOB  ACTIVITY  are  three  columns  -  (a) ,  (b) ,  and  (c) .  Notice  that 
under  "Using  Reference  Materials",  column  (a),  the  estimate  of  the  total 
number  of  uncommonly  effective  (UE)  performances  observed  during  the  past 
two  months  for  EM3  Tom  Henry  Jones  was  two.  That  is,  the  supervisor,  EMC 
Abner  Smith,  estimated  that  altogether  he-  observed  two  impressive  incidents 
of  performance  for  EM3  Tom  Henry  Jones  which  were  qualitatively  above  those 
usually  observed.  Similarly  for  column  (b) ,  the  supervisor’s  estimate  of 
the  total  number  of  uncommonly  ineffective  (UI)  performance  is  one.  Dis- 
regard  part  (c)  for  the  moment. 

The  estimates  recorded  on  the  JPQ  ANSWER  SHEET  will  be  machine  pro¬ 
cessed  and  must  be  accurately  recorded.  The  sample  on  page  13  together 
with  the  following  table,  illustrates  the  correct  procedure  for  recording 
one-digit  numbers  (numbers  0  through  9) ,  and  for  recording  two-digit 
numbers  (numbers  10  through  99) ,  in  various  positions  on  the  JPQ  ANSWER 
SHEET.  Review  the  table  in  conjunction  with  the  page  13  sample. 


JOB  ACTIVITY 

No.  of  UE 

No.  of  UI 

Using  Reference  Materials 

2 

1 

Equipment  Operation 

10 

5 

Electronic  Circuit  Analysis 

14 

12 

Personnel  Relationships 

0 

0 

Electro-safety 

Instruction 

0 

2 

Electro-repair 

2 

1 

Electro-cognition 

1 

1 

NOTE:  If  the  man  has  not  had  an  opportunity  to 

perform  a 

particular 

activity,  leave  that  job  activity  unmarked  (as 

shown  for  " 

'Instruction"  on 

the  sample  JPQ  ANSWER  SHEET). 

If  he  has  had  an  opportunity  to  perform  a  particular  activity,  but  has 
not  shown  any  uncommonly  effective  or  ineffective  performances,  enter  a 
zero  (0)  for  both  UE  and  UI  (as  shown  for  "Personnel  Relationships"  on 
the  sample  JPQ  ANSWER  SHEET) . 
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While  observing  a  technician  perform  any  of  the  eight  JOB  ACTIVITIES, 
you,  as  his  supervisor,  may  have  had  many  objectives  in  mind  which  you 
felt  he  should  be  striving  for.  However,  for  the  purposes  of  this  trial, 
we  ask  you  to  limit  your  attention  to  only  the  following  fleet  electronic 
maintenance  objectives: 


MEANINGS  OF  FLEET  ELECTRONICS  MAINTENANCE  OBJECTIVES 

1 .  Readiness 

To  maintain  efficiently  self,  subordinate  personnel,  equipment, 
and  systems  in  state  of  readiness  consistent  with  fleet  requirements. 

2.  Performance 


To  complete  any  given  mission  in  minimum  time  with  appropriate 
level  of  accuracy  and  reliability. 

3.  Operation 

To  obtain  optimum  system  output  when  equipment  is  operated,  i.e., 
output  characterized  by  precision  and  variability  appropriate  to  mission. 

4.  Safety 


To  carry  out  duties  with  maximum  protection  for  men  and  equip¬ 
ment  consistent  with  mission. 

5.  Preparation 

To  prepare  for  personnel  requirements  of  present  and  future  equip¬ 
ment,  systems,  and  situations  through  use  of  training  programs,  maintenance 
of  high  morale,  etc. 

***** 

After  recording  the  estimates  of  the  number  of  UE  and  UI  performances 
for  each  of  the  eight  JOB  ACTIVITIES,  complete  the  JPQ  ANSWER  SHEET  by 
placing,  in  column  (c)  for  each  job  activity,  your  reply  to  the  following 
question: 


0 
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QUESTION  (c)  Considering  this  man’s  overall  performance,  it  is 

your  opinion  that  the  importance  of  this  job  activity, 
as  a  factor  in  determining  the  overall  performance  of 
this  man,  is  best  described  as  being: 

3.  of  central  and  primary  importance 

2.  a  significant  factor,  but  of  secondary  importance 
1.  of  only  moderate  importance  in  estimating  overall 
performance 

0.  of  little  or  no  importance 


On  the  sample  JPQ  ANSWER  SHEET  on  page  13,  QUESTION  (c)  was  answered 
as  2,  3,  3,  2,  1,  0,  2,  3,  respectively  for  each  of  the  eight  JOB 
ACTIVITIES.  For  this  particular  man,  his  supervisor  felt  that  the  job 
activity,  "Equipment  Operation,"  was  of  primary  importance  as  a  factor  in 
determining  the  man’s  overall  job  performance. 

***** 


Answer  the  following  questions  in  the  block  marked  QUESTIONS  in  the 
lower  corner  provided  on  the  JPQ  ANSWER  SHEET. 

QUESTION  (d)  You  were  asked  to  recall  the  number  of  UE  and  UI  per¬ 

formances  that  you  have  observed  for  this  man  during 
the  past  two  months.  You  feel  that  a  reasonable  time 
span  for  evaluation  would  be: 


1. 

two 

months 

2. 

six 

weeks 

3. 

four  weeks 

4. 

two 

weeks 

5. 

one 

week 

QUESTION  (e)  What  degree  of  confidence  have  you  that  your  estimated 

number  of  UE  and  UI  performances  for  this  man  are  very 
close  to  the  actual  number  of  such  performances  that 
occurred  during  this  time  period? 

1.  My  estimates  are  probably  very  close  to  the  actual 
numbers. 

2.  There  may  have  been  a  few  UE  or  UI  performances 
more  or  less  than  my  estimates. 

3.  Cannot  be  too  sure  about  my  estimates.  It  was  very 
difficult  to  recall  UE.  and  UI  performances. 

4.  The  actual  number  of  UE  and  UI  performances  could 
be  very  different  from  my  estimates.  Recalling 
these  UE  and  UI  incidents  is  too  difficult  to  have 
any  confidence  in  such  estimates. 


11 


QUESTION  (f)  Aside  from  his  performance,  to  what  extent  are  this 

man’s  efforts  on  the  job  devoted  to  tasks  and 
activities  directly  related  to  his  rating?  Compare 
this  amount  of  rating-related  activity  to  the  average 
for  men  in  his  rating  and  paygrade. 

1.  Involved  in  definitely  more  rating-related 
activities  than  is  usual  in  his  rating  and  paygrade. 

2.  Involved  in  about  the  same  rating-related 
activities  as  usual  in  his  rating  and  paygrade. 

3.  Involved  in  less  rating-related  activities  than 
is  usual  in  his  rating  and  paygrade. 

The  above  questions  were  answered  as  2,  1,  and  3  respectively  on  the 
sample  of  the  JPQ  ANSWER  SHEET  of  page  13  of  these  Instructions. 

***** 

Finally,  place  your  social  security  account  number  in  the  block  pro¬ 
vided.  Also  be  sure  to  record  your  name,  rating  and  rate,  ship  and  its 
current  homeport  location,  date,  and  the  name  of  the  man  you  are  evaluating 
at  the  top  of  the  JPQ  ANSWER  SHEET. 
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PROBLEMS  IN  CALCULATING  RELIABILITY  RATIOS 


The  purpose  of  this  section  is  to  examine  the  frequency  with  which 
the  two  cases: 

1.  a  technician  did  not  work  at  a  job  activity,  and 

2.  a  technician  received  SUE  =  0  and  SUI  =  0, 

occurred  for  each  rating  and  job  activity  across  all  21  ships  participa¬ 
ting  in  the  project.  From  this  one  can  infer  on  the  extent  which  any 
convention  for  estimating  performance  in  those  cases  would  affect  indivi¬ 
dual  SRE,  PRE,  and  GRE  values. 

Refer  to  Table  E-l  on  page  E-4.  Each  square  in  the  table  represents 
the  number  and  proportion  of  technicians  by  rating  who  did  not  work  at  a 
particular  job  activity  or  received  SUE  =  0  and  SUI  =  0  by  their  super¬ 
visor.  Therefore,  on  job  activity  Number  1 ,  25  of  the  EM's  (or  25.8%  of 
the  EM's)  evaluated  either  do  not  work  at  that  job  activity  (Using  Refer¬ 
ence  Materials)  or  received  SUE  =  0  and  SUI  =  0.  This  may  seem  a  toler¬ 
able  level  of  occurrence  of  such  cases,  but  when  the  proportion  of  such 
cases  exceeds  .33,  one  should  begin  to  consider  whether  the  performance 
of  some  individuals  is  due  more  to  the  convention  that  must  be  adopted 
rather  than  to  the  individual's  own  job  effectiveness.  Of  the  64  squares 
in  the  table,  42  squares  had  one-third  or  more  of  the  men  in  some  rating 
falling  into  the  two  cases  for  some  job  activity,  25  squares  had  one-half 
or  more  of  the  men  in  some  rating  falling  into  the  two  cases,  and  most 
critically,  6  squares  had  at  least  75%  of  the  men  in  those  cases.  The  RD 
and  RM  ratings  were  particularly  notorious  for  this  type  of  situation 
occurring.  No  rating  seems  to  be  entirely  free  of  this  situation  for  some 
job  activities.  However,  some  ratings  significantly  demonstrate  this  effect 
for  many  job  activities. 
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25 

38 

96 

0,256 

0,220 

0,364 

23 

47 

49 

0,237 

0,272 

0,316 

42 

45 

79 

0.433 

0.260 

0,487 

43 

63 

93 

0,443 

0.460 

0,604 

23 

63 

60. 

0,237 

0,460 

.  0,519 

90 

116 

115 

0,515 

0.671 

0,747 

18 

48 

83 

'0,166 

0.277 

0,539 

35 

48 

64 

0,361 

0.277 

0,416 

Number  of  Men  Each  Rating 


97 


154 


173 


50 

53 

49 

6 

0,360 

0.3B7 

0,296 

0,154 

93 

42 

49 

13 

0,361 

0.307 

0,296 

0,333 

133 

104 

69 

26 

0,957 

0.799 

0,454 

0,667 

75 

77 

76 

10 

0,940 

0,562 

0,900 

0,256 

76 

50 

62 

11 

0,547 

0,369 

0,408 

0,262 

100 

66 

90 

20 

0.719 

0.642 

0,992 

0,913 

137 

128 

76 

25 

0,993 

0.934 

0,900 

0,641 

132 

114 

61 

22 

0.950  - 

0.832 

0,401 

0,564 

39 
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THE  ADOPTION  OF  A  CONVENTION 
FOR  EACH  JOB  ACTIVITY  AND  RATING 


This  section  discusses  the  finding  that  no  convention  can  be  adopted 
per  ship  that  will  account  for  those  cases  in  which  a  technician  either 

does  not  work  at  a  particular  job  activity  or  received  EUE  =  0  and  EUI  =  0 

from  his  supervisor.  As  an  example,  observe  Table  F-l .  This  table  is  of 
the  same  type  as  that  previously  reported  on  for  all  949  men  participating 
in  the  project  (Appendix  E,  Table  E-l).  However,  Table  F-l  is  reporting 
on  only  one  typical  ship  out  of  21  ships  in  the  project.  For  this  ship 
there  were  8  (out  of  64)  instances  where  one  of  those  two  cases  occurred 
for  all  men  in  some  job  activity  and  rating.  The  other  ten  ships  at 
Location  No.  1  demonstrated  16,  7,  8,  10,  13,  12,  5,  5,  5,  and  16  (out  of 
64)  instances.  The  10  ships  at  Location  No.  2  demonstrated  1,  16,  5,  15, 

7,  8,  16,  14,  10,  and  15  (out  of  64)  such  instances.  Therefore,  it  is 

impossible  to  form  an  average  estimate  (or  some  composite  value)  per  ship 

for  each  rating  and  job  activity  because,  in  some  ratings  and  job  activities 
on  all  ships,  there  are  no  technicians  who  received  either  EUE  or  EUI 
different  from  zero. 


Derivation  of  Composite  Reliability  Values 

In  order  to  overcome  the  aforementioned  problem,  the  convention  employed 
in  the  report  was  to  develop  a  composite  reliability  score  to  estimate 
technician  performance  on  those  job  activities  in  which  the  technician  re¬ 
ceived  EUE  =  EUI  =  0  or  did  not  work  at  that  particular  job  activity. 

Let  EUE(i,j)  be  the  sum  across  all  ships  at  a  location  of  all  EUE's 
over  all  men  in  the  ith  rating  and  jth  j0b  activity.  Similarily  the  sum 
of  all  EUI 1 s  is  calculated;  denote  this  sum  by  EUI(i,j).  The  composite 
reliability  score  for  the  i™  rating  and  jth  job  activity  is  defined  as: 

R(i,j)  =  EUE(i,j)/[EUE(i,j)  +EUI(f,j)]. 

This  particular  estimate  of  job  performance  provides  an  "expected"  level 
of  effectiveness  for  a  technician  in  the  ith  rating  and  jth  job  activity 
(for  ships  at  a  particular  location).  Table  F-2  gives  the  resulting  com¬ 
posite  reliability  values  (R(i,j))  for  each  rating  and  job  activity  at 
each  location.  For  example,  from  Table  F-2  and  men  at  Location  No.  1 
(Cruiser-Destroyer  FI otti 11a  NINE),  R( 1  ,3)  is  the  composite  reliability 
value  for  EM's  on  job  activity  number  3  -  Electronic  Circuit  Analysis  -  and 
is  given  by  R( 1 ,3)  =  .8465.  Reiterating,  it  may  be  said  that  for  all  EM's 
at  Location  No.  1  who  have  not  worked  at  job  activity  number  3  or  who 
received  EUE  =  0  and  EUI  =  0  for  that  job  activity,  their  reliability 
ratio  for  that  job  activity  is  expected  to  be  r 3  =  R(l,3)  =  .8465.  Simi¬ 
larly  this  procedure  is  employed  on  the  other  ratings  and  job  activities. 
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The  composite  reliability  score  is  an  estimate  that  always  can  be 
derived  when  many  ships  are  involved.  However,  it  does  not  overcome  the 
implications  of  the  results  discussed  in  Appendix  E  and  their  subsequent 
effect  on  the  estimates  SRE,  PRE,  and  GRE. 


TABLE  F-l 


NUMBER  AND  PROPORTION  OF  TECHNICIANS  IN  PROBLEM  AREAS  ON  A  PARTICULAR  SHIP 
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TABLE  F-2 


COMPOSITE  RELIABILITY  VALUES 


Location 

No.  1 

Job 

Activity 

l 

EM 

0.8770 

ET 

0.6831 

FT 

0.7160 

Rating 

IC  RD  . 

0.7466  0.9257 

RM 

0.9310 

ST 

0.8537 

TM 

0.7333 

2 

0.9050 

0.7733 

0.7802 

0.8217 

0.9110 

•  0.9497 

0.8899 

0.8165 

3 

0.8465 

0.6932 

0.7340 

0.7981 

0.9000 

1.0000 

0.8662 

0.8667 

4 

0.8639 

0.5987 

0.7890 

0.7692 

0.9300 

0.9671 

0.8930 

0.7733 

5 

0.9004 

0.7706 

0.9107 

0.7865 

0.9012 

0.9712 

0.9161 

0.7284 

6 

0.9333 

0.8481 

0.8435 

0.8039 

0.9677 

0.9877 

0.8571 

0.8974 

7 

0.8981 

0.7872 

0.8701 

0.8163 

1.0000 

1.0000 

0.9078 

0.8269 

8 

0.8744 

0.7097 

0.7771 

0.8105 

1.0000 

0.9949 

0.8571 

0.7419 

Job 

Activity 

EM  . 

ET 

FT 

Location  No.  2 

Rating 

IC  RD 

RM 

ST 

TM 

l 

0.9101 

0.7203 

0.8552 

0.7879 

0.8352 

0.8351 

0.8547 

0.5806 

2 

0.8962 

0.7110 

0.8808 

0.8673 

0.9017 

0.8673 

0.8567 

0.8095 

3 

0.8342 

0.7803 

0.8673 

0.7719 

1.0000 

0.8402 

0. 8194 

0.0909 

4 

0.9586 

0.6729 

0.8167 

0.9333 

0.8214 

0.8240 

0.7950 

0.7317 

5 

0.8987 

0.8244 

0.9032 

0.9718 

0.8649 

0.9667 

0.9135 

0.6000 

6 

0.9530 

0.7368 

0.9231 

0.8095 

0.7975 

1.0000 

0.6759 

0.8333 

7 

0.9441 

0.7866 

0.8819 

0.8240 

0.0000 

1.0000 

0. 8148 

0.5714 

8 

0.9120 

0.7918 

0.8827 

0.8267 

0.7059 

1.0000 

0.8357 

0.4167 
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A  FEW  REMARKS  ON  CURVILINEAR  REGRESSION 


Let  Y  be  a  criterion  variable  and  let  X  be  a  predictor  variable.  If  N 
is  the  number  of  observations  on  each  of  X  and  Y,  then  Y*  =  [Y.,  ....  Yw] 
is  the  row  vector  of  N  observations  on  Y.  For  a  given  matrix  A ,  A*  will  be 
the  transpose  of  A .  In  particular  one  wishes  to  establish  a  regression  equa¬ 
tion  for  a  particular  response  Y  in  terms  of  the  variables  X,  X  ,  X3;  i.e. 
it  is  desirable  to  establish  which  of  the  three  power  curves  (linear,  quad¬ 
ratic,  or  cubic): 


Y  = 


Bo+ 


P 

E 

i=l 


*i 


p  =  1 ,  2,  or  3 


best  fits  the  observations  obtained  on  X  and  Y.  The  above  equations,  in 
terms  of  the  sample  observation  vectors,  can  be  expressed  in  matrix  nota¬ 
tion  as: 


Y  -  X&  +  E 

where  Y  was  defined  above.  The. matrix  X.  -  [J,  X. ,  x.y  xA  where 
J'  =  [1,  ...»  l]lxN  and  X\  -  [xj,  ...»  X’]  for  i  -  1,2,  or  3.  There¬ 
fore  ^  is  an  N  x  1  column  vector  of  observations  on  the  predictor  variable. 

3'  s  [80,  ...»  Bl  is  the  vector  of  p  +  1  regression  parameters.  £"s[e, , . . .  ,ef,] 
is  the  vector  or  errors  due  to  lack  of  fit  in  the  particular  model.  One 
wishes  to  estimate  8  such  that  the  error  sum  of  squares  is  minimized.  In 
particular  a  least  squares  estimate  8*  of  8  is  given  by 

t  =  {x’x)~^x'y 

provided  the  square  matrix  xx  X  is  nonsingular  and  the  regression  problem 
has  been  properly  expressed.  The  usual  assumption  one  makes  is  that  is 
distributed  with  mean  [0,  ...»  0]^xN  and  variance-covariance  matrix  cr I 

where  I  is  the  identity  matrix.  The  term  is  called  the  common  error  va¬ 
riance  of  the  observations.  The  assumption  of  normality  of  the  error  vector 
is  not  required  in  order  to  obtain  the  least  squares  estimates  for  any  of 
the  parameters  in  the  regression  equation.  Because  any  assumption  of 
normality  for  e  implies  that  the  observations  on  X  or  Y  are  normally 
distributed,  this  report  will  only  be  concerned  with  least  squares  esti¬ 
mates.  One  cannot  in  general  discuss  normality  on  X  or  Y  because  of  some 
results  in  this  report  where  it  is  shown  that  the  distribution  of  TP  scores, 

SRE,  PRE,  and  GRE  are  not  normally  distributed  (see  Table  17  and  page  21). 
Therefore  it  is  imperative  that  the  reader  be  aware  that  while  the  assump¬ 
tion  of  E  being  normally  distributed  is  not  required  in  order  to  obtain  fT, 
it  is  required  in  order  to  make  tests  of  hypotheses,  as  contained  in  an 
Analysis  of  Variance  Table.  These  tests  are  the  usual  t-  or  F-tests  and 
they  cannot  be  applied  validly  to  the  sample  data  collected  at  either  loca¬ 
tion  nor  on  the  combined  sample  consisting  of  949  technicians  for  the  varia¬ 
bles  SRE,  PRE,  GRE,  and  TP  score  (see,  for  example,  Draper  and  Smith  [7], 
page  59). 
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A  Least  Squares  Analysis  of  the  Sample  Data 

It  is  possible  that  a  least  squares  analysis  can  be  attempted  in¬ 
dependently  of  the  distributional  properties  of  the  criterion  and  pre¬ 
dictor  variables.  For  a  particular  predictor  variable  (X)  and  criterion 
variable  (Y),  the  multiple  correlation  coefficient  (R2)  provides  a  measure 
of  the  proportion  of  the  total  variance  about  the  sample  mean  for  the 
criterion  variable  explained  by  a  particular  regression  model.  The  term 
R2  is  defined  as: 


R2  = 


Sum  of  squares  due  to  regression  -  Sum  of  squares  due  to 
Total  (corrected)  sum  of  squares 


=  {$X'Y 


41)  /  Wi¬ 


lt  should  be  clear  that  the  larger  R2  is,  the  better  the  fitted  equation 
explains  variance  in  the  criterion  variable.  Furthermore,  0  5  R2  <  1 , 
and  therefore  R2  =  1  implies  a  perfect  fit.  However  there  are  a  few  prob¬ 
lems  with  this  approach  (see,  for  example  Draper  and  Smith  [7],  page  63). 
One  must  weigh  the  value  of  R2  with  the  least  squares  estimate  (s2)  of  the 
common  error  variance  (a2)  where 


s2  =  residual  mean  square 
»  (i"J  -  Tp)  /  (N  -  P  *  1). 

Of  course,  the  smaller  s2  is  for  a  particular  model  under  consideration 
the  better  the  model  fits  the  data.  Therefore  the  approach  is  to  weigh 
increases  in  R2  with  decreases  in  s2  in  order  to  arrive  at  the  best  least 
squares  model  for  the  data. 
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APPENDIX  H 

RESULTS  OF  THE  CURVILINEAR 
REGRESSION  ON  949  TECHNICIANS  EVALUATED 
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a:a::s3B33)TJIja331l:3|IB3:33l3aB3U3S13l3Ba33l33:;i:4ai:333S3CII33a3133:3 

POLYNOMIAL  riTIlHO  F0B  2  VAHlAOLES-SRE  AND  TP  SCBRIi.  ,  V-ty  OaSERVAT l 3NS , 


THE 

predictor 

VARIABLES) 

IS  SRE ,  AND  THE 

CO l ?EO I  ON 

VAR  lABLB  IY  >'  JS  TP'1  SCORE 

TEST 

MEANS  AND 

STANDARD  DEVIATIONS 

1 

X 

0.331 

0,323 

2 

SQUAR 

0.214 

0.288 

3 

X  CUBE 

0.159 

0.265 

4 

Y 

5.35Q 

2.340 

CORRELATION  matrix 

1 

X 

1.000 

0.933 

0,887 

0,055 

2 

SQUAR 

0.953 

1.000 

0,983 

0,032 

3 

X  CUBE 

0,887 

0.983 

1,000 

0,034 

4 

Y 

0.053 

0.032 

0,034 

1,000 

13333::3:33333:33:33:33333::s:333333:3333:3333l33:;3333l3313333a>:33333313 

FIRST,  SECOND,  AND  THIRD  DEGREE  POLYN0M  t  A  US  , 

.c:3:333:3:333333::E3::3::3:33;3:3::3:333i3ia3333:3j:3:^3i333:iss3i3iS33333 

MULTIPLE  R  SCUARE  o  0,003 
MULTIPLE  R  a  0.055 

N.D.F.l  a  1 
N.D.F.2  *  947 

f  for  analysts  of  variance  on  r  h  2,850 
UE  T  A  WEIGHS 
0,055 

CONTRtBUT I8NS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS,  2ND  COLUMN) 

1  A  O-OO3  . 1 >00  0 

SQUARED  BETA  WEIGHTS 
0.003 
B  HEIGHTS 
0.397 

INTERCEPT  CONSTANT  a  3.219  .... 

::3:33:s3333:33:333::333S3:333l33333333l33333333::;r33t33:33333l33SI333333 

MULTIPLE  R  SCUARE  *  0,007 

MULTIPLE  R  a  0.086 
N.D.F.l  a  2 
N.D.F.2  a  946 

)  FOR  ANALYSIS  0F  VARIANCE  0N  R  9  3,537 

BETA  WEIGHS 
0.264  -0,220 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS,  2ND  COLUMN) 

1  A  0*01*  0'636 

2  SQLAR  <,0,0Q7  0.372 

SQUARED  8ET A  WEIGHTS 

0.070  0,048 

B  WEIGHTS 

1.912  ->1,783 

INTERCEPT  C0NsTANt  8  5,098  .  .  ,  .  . 

3333::S:333333:3:33333l33:3333i:3333:S33l33ia33333;:33|l333333ai33333,333a 

MULTIPLE  R  SCUARE  9  0,043' 

MULTIPLE  R  a  0,207 

N.D.F.l  a  3 
N.D.F.2  a  949 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R. 9  .14,091  .  ... 

BETA  WEIGHS 

1,492  -3,627  2,276 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS,  2ND  COLUMN) 

1  X  fl,092  0.265 

2  SOLAR  sO  .  116  0.155 

3  X  CUBE  0,077  0.164 

SQUARED  BETA  WEIGHTS 

2.226  13,157  5.179 

B  HEIGHTS 

10.803-29,457  20,101' 

INTERCEPT  CONSTANT  •  4.869 


AN0VA  TABLE  FOR  POLYNOMIALS  .  . 

3:33:33:I:lc;3a3333B3:33333333l33:33:3ai33a333l333;il3SI3S3S3333B33|33lll3 

REDUCTION  DLE  TO  LINEAR  FIT,  WITH  i  Df  >  0,003 

RESIDUAL  S.S,  a  o>997  DF  a  947  RESIDUAL  M.S,  a  0,001 

F  FOR  LINEAR  FIT  a  2,830 

13:B3S3:S:,31:3:3:33::3333333E3:33:33l3alBI3l3:i3l|E33,333333333333l33aa33 

REDUCTION  DLE  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2,  a  0.007 

REDUCTION  M.S.  a  0,004 

RESIDUAL  S.S.  a  0,993  DF  4  946  RESIDUAL  M.S,  a  0,001 

F  FOR  QUADRAT  I C  FIT  a  3.537 

REDUCTION  CUE  TO  QUADRATIC  TERM  ALONE,  WITH  1  OF,  |  0,004 

f  FOR  QUADRATIC  TERM  ALONE  a  4,2i5 

. . . . 31  33333 33, 31 331), 311 IIBS3 33 3  I  313 3,333  I, 


REDUCTION  DUE  to  GENERAL  CUBIC  FIT  WITH  OF  3,  »  01043 

REDUCTION  M.S.  a  0.014 

RESIDUAL  S.S,  a  Q.957  DF  «  949  RE3 1  DUAL  M.S,  »  0,001 


f  for  general  cusic  fit  a  i4,09i 

REDUCTION.  CUE  TO  CUBtC  TERM  ALONE  H ! TH  1  DF  a  ,  0.035 

F  FOR  CUBIC  tERM  ALONE  a  J4,943 
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a:s:i3;3a33;i;J:aa?3r3|4ij;:c:8::a'jj3:aji23D:;ii;,jja.j3:»-3333*:2i«:jJao» 

pau  VNOM  I AL  F  I T  r  I  NO  F0R  2  VARlA5LES-PRfc  A  NO  IP  SCORE.  949  Q3SEHVA  t 1 <$N$  , 


THE  PREDICTOR  VAR  1  ABLE { X )  IS  PRE,  AND  THE  CHI tERION  VAR l ABUS  if )  JS  TP  SCORE 


TEST 

MEANS 

AND  STANDARD 

DEVIATIONS 

1 

X 

0.558 

0,407 

2 

SQUAR 

0,477 

0.388 

3 

X  CUBE 

0,420 

0.377 

4 

Y 

9,350 

2,340 

correlation 

MATRIX 

1 

X 

1,000 

0,976 

0,934 

0,100 

2 

SQUAR 

0.976 

1,000 

0,989 

0,063 

3 

X  CUBE 

0.934 

0  .989 

1,000 

0,036 

4 

Y 

0.100 

0.063 

0,036 

1,000 

::s:::s:::33::3:3:i3::ii3::3i:t:3:3i3:3:333st::t3s|is::ns:sa:i:iti9i:!3m 

FIRST,  SECOND,  AND  THIRD  DEGREE  P0LYN0HIALS, 

i:::::::::::329:3:t3::i>::::i:o:ic:9:::i:;l>::s>:3]3icfi3a:3:i:i31i::3:3SI 

MULTIPLE  R  SCUARE  D  0,010 
MULTIPLE  R  *  0.100 

N.D.F  .1  3  1 

N.D.F.2  a  947 

F  FOR  ANALYSIS  GF  VARIANCE  ON  R  4  9,970 

BETA  WEIGHS 

0.100 

CONTRIBUTIONS  T0  HULTIPLE  C0RRELAT  I8N 

AND  REGRESSIGN  FACTOR  LOADINGS',  2ND  COLUMN) 

1  X  0.010  1.000 

SQUARED  BETA  WEIGHTS 
0.010 
0  WEIGHTS 
0.576 

INTERCEPT  CONSTANT  *  9,028 

MULTIPLE  R  SCUARE  •  0,036' 

MULTIPLE  R  9  0,189 

N.D.F.l  a  2 
N.D.F.2  s  946 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  *  17,908 

BETA  WEIGHTS 
0.817  -0.734 

CSNTRIBUI I SNS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACT0R  LOADINGS,  2ND  COLUMN) 

1  X  0.002  o*53o 

2  SOLAR  .0,046  0.332 

SQUARED  SETA  WEIGHTS 

0.667  0.939 

8  WEIGHTS 

4.700  -4,431 

INTERCEPT  CONSTANT  3  4,8?8  . 

::::::s:::::i:i::::33:i:e::3i,i33:333:3si:a»3Bi3ij:i:;333:::i9iaclt:3is3i 

MULTIPLE  R  SQUARE  ?  0,036' 

MULTIPLE  R  3  0,189 

N.D.F.l  a  3 
N.D.F.2  a  945 

F  FnR  ANALYSIS  gF  VARIANCE  gN  R  8  11,669 

BETA  WEIGHS 


Q.754  -0,579  -0.099 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 


AND  REGRESSION  f ACT0R 

LOADINGS',  2ND  COLUMN) 

1  X  0 • 075 

0.529 

2  SOLAR  >0,036 

0,332 

3  X  CUBE  >0,003 

0.192 

SQUARED  BETA  WEIGHTS 

0,569  0.335  0.009 

B  WEIGHTS 

4.341  -3,495  -0,590 

INTERCEPT  CONSTANT  ■ 

4,841 

AN0VA  TABLE  F0R  POLYNOMIALS  . 

:::::::3t::33:3:3:3S3:ii3::33333a3:i8333l33|3a3t3:;S33iic33t3333333ic3a3M 

REDUCTION  DUE  T0  LINEAR  FIT,  WITH  1  DF  a  0,010 

RESIDUAL  S.S,  «  g,990  OF  •  947  RESIDUAL  M.S.  »  OiOOl 

F  FOR  LINEAR  FIT  a  9,976 
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REDUCTION  OLE  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2,  ■  0.036 

REDUCTION  M.S,  a  0,018 

RESIDUAL  S.S,  •  0,964  DF  9  946  RESIDUAL  M.S,  *  0,001. 

F  FOR  QUADRATIC  FIT  »  17,508 

REDUCTION  CUE  TO  QUADRATIC  TERM  ALONE ,  WITH  1  DF,  s  0,024 

F  FOR  QUADRATIC  TERM  ALONE  »  25,1.95 

c33333:Bii3i::3iaia3s:3Ssc:83iBia33a33aii33iia3Baali3B|333:,iiii3isaiii33i 


REDUCTION  CUE  TO  GENERAL  CUBIC  FIT  WITH  DP  3.  ■  01036 

REDUCTION  M.S,  a  0,012 

RESIDUAL  S.S,  i  0,964  DF  «  949  RESIDUAL  M.S,  ■  0,001 

F  FOR  GENERAL  CUBIC  FIT  »  11,669 

REDUCTION  CUE  TO  CUBIC  TERM  ALONE  WITH  1  OF  •  »  0,000 

I  FOR  CUBIC  TERM  ALONE  «  0,016 

ii3:i3,,i,isiti,ii||ii:|>>33>it33  3i3isi,ai3iiB33iia{33B;imi3aii33i3iia3ai 


S813B;333lS:i33:3:332:Ba:i3333Sa333B.i:a33;i:i)3  4  3S33Jt3:Sa33:32i:iBaMia3Sai 

POLYNOMIAL  FITTING  F0R  i  VARIABLES-GRE  AMD  TP  SC3HE-.  949  OHSERVAT  IPNS, 


,  THE  PREDICTOR  VARIABLG(X)  IS  QREg  and  THE  CRITERION  VAR  I  ABLE  ( Y )  IS  TP  SCORE 


TEST 

MEANS 

AND  STANDARD 

DEVIATIONS 

1 

X 

0,927 

0.149 

2 

SQUAR 

0.879 

0.177 

3 

X  CUBE 

0,839 

0.210 

4 

Y 

9.390 

2.340 

correlatien 

MATRIX 

1 

X 

1,000 

0.996 

0,899 

0,087 

2 

SQUAR 

0,996 

1.000 

0,986 

0,081 

3 

X  CUEE 

0.899 

0.986 

1,000 

0.077 

4 

Y 

0.087 

0.081 

0,077 

1,000 

FIRST,  SECGNC,  AND  THIRD  DEGREE  POLYNOMIALS, 

MULTIPLE  R  SCUARE  a  0,008 
MULTIPLE  R  s  0.087 

N.D.F  .i  a  1 
N.U.F.2  »  947 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  7,161 

BETA  WEIGHTS 
0.087 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

and  REGRESSION  factor  LOADINGS.  2ND  COLUMN) 

1  X  0.01)8  1.000 

SQUARED  BETA  WEIGHTS 
0,008 
B  WEIGHTS 
1.400 

INTERCEPT  CONSTANT  4,093  . 

s:s=ssa:a=asas3si:asssa:a:::3sassasa=:3sS333sasasaj:;={|a:c=csa:aRaaasasaaa 

MULTIPLE  R  SQUARE  9  0,008' 

MULTIPLE  R  a  0,087 
N.D.F.l  »  2 

N.D.F.2  a  946 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  3,989 

BETA  WEIGHTS 
0.103  *0,017 

CONTRIBUTES  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS'.  2ND  COLUMN) 

1  X  0-009  0 .998 

2  SOLAR  *0,001  0,937 

SQUARED  BETA  WEIGHTS 

0.011  0,000 

B  WEIGHTS 

1.663  -0,225 

INTERCEPT  CONSTANT  B  4,006 

asssssssasssaaasassassasBssaaaaaaaaassassaaaasaaaai-asfiaaaaasasaaaaaaasaaa 

MULTIPLE  R  SCUARE  9  0,009 

MULTIPLE  R  a  0,094 

N.D.F.l  ?  -3 

N.D.F.2  a  949 

f  FOR  ANALYSIS. OF  VARIANCE  ON.  R  t  2,799 

BETA  WEIGHTS 

0,661  .1,942  1,009 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS,  2ND  COLUMN) 

1  X  0.097  0.923 

2  SOLAR  nO.125  0,867 

3  X  CUBE  0,077  0.816 

SQUARED  BETA  WEIGHTS 

0,438  2,378  1.010 

B  WEIGHTS 

10.690  >20,332  11,213 

intercept  constant  »  3,914 


ANOVA  TABLE  FOR  POLYNOMIALS  ...... 

szsssicassssaaasasaesaasssssssaaaBaaBaaaasBassaaaasaasiaaasssaiaiaaaaaaaaa 
REDUCTION  DUE  TO  LINEAR  FIT,  WITH  1  DF  a  0,008 

RESIDUAL  S.S,  a  q , 992  DF  «  947  RESIDUAL  M.S,  »  QiOOl 

F  FOR  LINEAR  FIT  a  7,161 

33,9999g3:aaai,9i3;i:9g:i9999:giaaia9:93999i,iii99)999iici3399igiiaiai099, 

REDUCTION  DUE  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2’,  a  0,008 

REDUCTION  M.S ,  a  0,004 

RESIDUAL  S.S,  a  0,992  OF  a  946  RESIDUAL  M.S,  a  0,001 

F  FOR  QUADRATIC  FIT  »  3,989 

REDUCTION  CUE  TO  QUADRATIC  TERM  ALONE,  WITH  1  DF,  9  0,000 

F  FOR  QUADRATIC  TERM  ALONE  •  0.024 

999999,9l993a399llll9:l3l999igi,a,9,919,99g,lgl,g9ia99|a:i993llalila99lla, 

REDUCTION  DUE  TO  GENERAL  CUBIC  FIT  WITH  DF  3i  «  OjOOO 

REDUCTION  M.S,  a  0,003 

RESIDUAL  S.S,  a  0,991  Dr  a  945  RESIDUAL  M.S.  a  0,001 

f  for  general  cubic  fit  •  2,79a 

REDUCTION  DUE  TO  CUBIC  TERM  ALONE  wlTH  1  DF  a  ,  0,001 

F  F OR  CUBIC  TERM  ALONE  a  1,215 

aaaaaiaaiaaaaaaaaagaaigaaaaaaaaaaiaaaagaaalaaaiaaaiaaaaaaaaaaaaaialaaailai 


::::3  =  333:aca:l;;:i3::|B33:a  sincaaisailsiiai::  z j  c  -jiaiaasiaasiiiasaiaa 

POLYNOMIAL  FITTING  FOR  2  VAN 1  ABLES-HRE  AND  TP  SCfIREa  94 9  OnSFRVAtJONS 


THE  PREDICTOR  VARIABLE!*)  IS  WRE,  AND  THE  CRITERION  VARIAGlBIY)  '|5  TP  SC0R6 


TEST 

MEANS  AND 

STANDARD 

deviations 

1 

X 

0,603 

0.204 

2 

SQUAR 

0  . 409 

0,231 

3 

X  CUBE 

0.290 

0.227 

4 

Y 

9.350 

2.340 

CORRELATES  MATRIX 

1 

X 

1.000 

0.970 

0,920 

0.297 

2 

SQUAR 

0.970 

1.000 

0,986 

0,247 

3 

X  CUEE 

0.920 

0.986 

1,000 

0,229 

4 

Y 

0.257 

0.247 

0,229 

1,000 

II 

II 

II 

II 

II 

It 

U 

II 

3s:sssss33s:ss:s83ss:ass 

33  a:s  93 :a  ssesis 

II 

11 

U 

II 

« 

FIRST 

,  SECOND, 

AND  THIRD 

DEGREE  POLYNOMIALS, 

s:::s:::s3 

:::: 1:1:31:0:: 

S  5  3  3  ■  3  9  3  C  3  3  S  if  3  3 

383333: 

MULTIPLE  R  SQUARE  >  0,066 

MULTIPLE  fl  a  0.257 


333331333131 

331313331113 


N.O.F.l  *  1 

N.D.F.2  »  947 

F  FOR  ANALYSIS  OF  VARIANCE  ON  ft  A  67,017 
BETA  HEIGHTS 
0.297 

CONTRIBUTIONS  to  multiple  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS',  1 2ND  COLUMN ) 

1  X  0.0*®  1*000 

SQUARED  BETA  HEIGHTS 
0.066 
B  HEIGHTS 
2.950 

INTERCEPT  CONSTANT  «  3,971 

3333:33::333:3:3::;3::i:i:;:::i33:3a:::i3:333;ii::3:::ii3333:ii,,i33:33*3, 

MULTIPLE  R  SQUARE  •  0,066 

MULTIPLE  R  *  0.297  » 

N.O.F.l  *  2 


N.D.F.2  *  946 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  9  33,919 

BETA  HEIGHTS 
0.294  -0.038 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS,  2ND  COLUMN) 

1  X  O.O?6  0 .999 

2  SOLAR  ^0.009  0.961 

SQUARED  BETA  HEIGHTS 

O.OS6  0.001 
8  HEIGHTS 

3/371  -0,384 

intercept  constant  *  3,473  .... 

::3:s:::3sa::3S:3:3::ai:33::iii3iiais;ai3a3i:a8::i;a:::isisa:aiiiii3S3iasa 

MULTIPLE  R  SQUARE  9  0,071  ' 

MULTIPLE  R  a  0.266 

N.D.F.l  a  3 
N.D.F.2  ■  949 

F  FOR  ANALYSIS  OF  VARIANCE  0N  R  >  23,99? 

BETA  HEIGHTS  *  • 

-0.337  1.972  -1,012 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS',  2ND  COLUMN) 

1  X  »0  •  0®7  0 ,966 

2  SOLAR  0.389  0.929 

3  X  CUBE  >0.231  0.859 

SQUARED  BETA  HEIGHTS 

0.113  2.472  1.024 

8  HEIGHTS 

-0.865  19,953  -10.493 

INTERCEPT  CONSTANT  »  4.248 


AN9VA  TAELE  FOR  POLYNOMIALS  .  .  .  .  .  . 

REDUCTION  DUE  TO  LINEAR  FIT,  WITH  1  DF  i  0,066 

RESIDUAL  S.S,  >  0,934  DF  *  947  RESIDUAL  M.S.  »  0*001 

F  FOR  LINEAR  FIT  >  67,017 

azasasasasasasasasaaszaaaaaaaaazaaaaaaaaaiBaaaaaaslaassaaaaasiaaaaaaaaaaaa 

REDUCTION  DLE  TO  GENERAL  QUADRATIC  FIT  HITH  OF  2,  a  0.066 

REDUCTION  M.S,  a  0.033 

RESIDUAL  S.S.  a  0.934  OF  9  946  RESIDUAL  H.S,  >  0,001 

F  FOR  QUADRATIC  FIT  a  33.519 

REDUCTION  CUE  T0  QUADRATIC  TERM  ALONE,  WITH  1  DF ,  |  0,000 

F  FOR  QUADRATIC  TERM  AQSNE  »  o*085 

REDUCTION  CUE  TO  GENERAL  CUBIC  Fit  HITH  o f  3,  •  0J071 

REDUCTION  M.S,  a  0.024 

RESIDUAL  S.S,  a  0,929  DF  9  945  RESIDUAL  M.S,  «  0,001 

f  for  general  cubic  fit  »  23,999 

REDUCTION  CUE  TO  CUBIC  TERM  ALONE  Ht  TH  1  DF  I  ,  0,009 

F  f  OR  CUBIC  TERM  ALONE  a  4,698  , 

ia3a33aiiili3ai3i3|S33llliil||li|ll|l?,‘IIIMI|l91l]ill|||8llllM9H|iallll 


APPENDIX  I 

RESULTS  OF  THE  CURVILINEAR 
REGRESSION  ANALYSIS  BY  RATING 
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IOS|BISBJiai|||SMttBa«IBl*88l|l8S*  »  3  O  9  «  ■  O  O  8  tt  s  ■  3  a  9  9  *  « I «  I  S  81  SS  3B  IIS  I  ■  |  8  |  S  a  1 1| 

POLYNOMIAL  FITTINO  FOR  2  VARIA^LES-SBE  ANO  jP  SCORE-  9 7  OBSERVATIONS. 


EM  RATING 


THE 

predictor 

VARIABLES)  IS  SREa  ANO 

the  criterion 

variable(Y)  is  tp  score 

TEST 

MEANS  AND 

STANOARO 

DEVIATIONS 

1 

X 

0.413 

0.302 

2 

SOUAR 

0.?60 

0.276 

3 

X  CUBE 

0.109 

0.258 

4 

Y 

6.000 

1.953 

correlation  matrix 

i 

X 

1.000 

0.943 

0.867 

0.363 

2 

SQUAR 

0.945 

1.000 

0.98o 

0.364 

3 

X  CUBE 

0.867 

0.900 

1.000 

0.328 

'4 

Y 

0.365 

0.354 

0.328 

1 .000 

. . . 

FIRST  I  SECOND.  ANO  THIRD  nEGREE  POLYNOMIALS. 

ici3iisi3iii3iiBniiii9i:ai*saasiaiiae3ii3iaai:iii3iii)iisiiiiaaiiaaiiaa3tii 

MULTIPLE  R  SOUARE  a  0.133 
MULTIPLE  R  ■  0.363 

N.O.F.l  a  I 
N.0.F.2  ■  95 

F  FOR  ANALYSIS  OF  variance  ON  R  a  14.560 
BETA  WEIGHTS 
0,365 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FACTOR  LOaoINGSi  2ND  COLUMN! 

T  X  0.133  1.000 

SOUAREO  BETA  WEIGHTS 
0.133 
B  WEIGHTS 
2.358 

INTERCEPT  CONSTANT  a  5*027 

aaiaaaiasaaasssaaaaisBassaasissaaaiasaaaaissiasaaaasaaaassaiaiiaiiaasiiaai 

MULTIPLE  R  SOUARE  ■  0.136 

MULTIPLE  R  •  0.369 

N.O.F.l  a  g 
N.0.F.2  a  04 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  7.420 

BETA  WEIGHTS 
0,196  0.179 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FAcTCR  LOAOlNGSt  2ND  COLUMN) 
f  X  0.071  0 , 9f 7 

2  SOUAR  0.065  0.985 

SOUAREO  BETA  WEIGHTS 
0.038  6.032 

8  WEIGHTS 

1.265  1.266 

INTERCEPT  CONSTANT  •  5«14B 

lesiiarsa.iiiiaa.Hiasas^iaaiiasaaaiaiiasainaaisi.iiiai.iiaiiaiataiiMiaiai 

MULTIPLE  R  SOUARE  •  0.1(6 

MULTIPLE  R  ■  6.419 

N.O.F.l  •  3 

N.O.F.2  a  93 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  •  6.615 

BETA  WEIGHTS 
•1.120  3.778  -2.404 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FACTOR  LOaoINGSi  2ND  COLUMN) 

1  X  -0.408  0.859 

2  SOUAR  1.374  0.867 

3  X  CUBE  -0,790  0.703 

SOUAREO  BETA  WEIGHTS 

1.255  14.276  3.779 

B  WEIGHTS 

-7.246  26.733  -18.221 

INTERCEPT  constant  «  5.404 


ANqVA  TABLE  for  polynomials 

aaaaaiaaaaaaaaiaaaaiaaaaiaaiiaaiaaaiaaiaaaiiaaaiaiaiaMaaaiiaaauaaaaaaaaa 

REDUCTION  OUE  TO  LINEAR  FlTt  WITH  1  OF  a  0.133 

RES IOUAL  S.S,  a  0.867  OF  a  95  RESIDUAL  M.S.  a  0.009 

F  FDR  LINEAR  FIT  a  14.560 

aaaaaaaaaaaaaaaaaaaanaaaaaaaaaaaaaaaaaaaaaaaaaaaiaaaaaaaaaaaaaaaaaaaaaiaa 

REDUCTION  OUE  TO  GENERAL  OUAORATIC  FIT  WITH  OF  2a  ■  0.136 

REDUCTION  M.S.  a  0.068 

RESIDUAL  S.S.  a  0.864  OF  ■  94  RESIDUAL  M.S.  M  0.009 

F  FDR  QUADRATIC  FIT  a  7*420 

REDUCTION  DUE  TO  QUADRATIC  TfRH  ALONEa  WITH  l  OFt  ■  0.003 

F  FOR  OUAORATIC  TERM  ALONE  a  0.375 


REOUCTION  OUE  TO  GENERAL  CUBIC  FIT  WITH  OF  3t  0.176 

REOUCT I ON  M.S.  ■  0.05^ 

RESTOUAL  S.S.  ■  0.824  OF  a  93  REStOUAL  M.Sa  •  0.009 

F  FOR  GENERAL  CUBIC  FIT  a  6.615 

REOUCTION  OUE  TO  CUBIC  TERM  ALONE  WITH  \  OF  •  0.040 

F  F()R  CUBIC  TFRM  ALONE  a  4.460 

a  a  «s  ■  *  a  a  sna  isssaai  aismM>a«>i«ti  as  as  siisiignaiiiis  aassa  ■•■■•at  s*aas 


B30ui»o3*aaB«(4'3i3:x3iaajsaQo»«a3*sy3a3e:v*33:i3oa2**n3*ar,!!»a8i«**aiiiua3B3i:--332««38*'»»a3a 
POLYNOMIAL  FITTING  f  OR  2  VAN  I aULES-PRE  ANO  T*  SCORE.  97  OBSERVATIONS  . 

EM  RATING 

THE  PREDICTOR  VARIAAi.E<X>  IS  PPE.  Ano  ThE  CRITERION  VaPUBLEiY)  -IS  Tp  SCORE. 


TEST  MEANS  ANO  STANOARO  DEVIATIONS 
I  X  0.481  0.370 

?  SOUAR  0,599  0.36A 

3  X  CUBE  0.539  0.359 

A  Y  6.000  1.953 

CORRELATION  MATRIX 

1  X  1.000  0.979  0.942  6.2*7 

2  SOUAR  0.979  1.000  0.990  0*297 

3  X  CUBE  0.9A2  0.990  1.000  0.322 

A  Y  0  •  ?A7  0.297  0.322  1*000 

. . . . . 

FIRST,  SECOND,  and  THIRD  DEGREE  POLYNOMIALS. 

MULTIPLE  R  SOU ARE  «  o .06 1 
MULTIPLE  R  ■  0*2*7 

N.O.E.i  ■  ) 

N.P.E.2  «  95 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  6*163 

BFTA  WEIGHTS 
0.2A7 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOaoINGSi  2N0  COLUMN) 

T  X  0.061  1.000 

SQUARED  BETA  WEIGHTS 
0,061 
B  WEIGHTS 
1.303 

INTERCEPT  CONSTANT  ■  5.112 

MULflPLE  R  SQUARE  «  6.133 

MULTIPLE  R  ■  0.365 

N.O.F.l  ■  2 

N.O.F.2  ■  94 

F  FOR  ANALYSIS  OF  VARIANCE  On  R  ■  7.238 

BETA  WEIGHTS 
-1,033  1 ,3ii7 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  L0aoINGS«  2NO  COLUMN) 

T  X  -0,255  •  0.6?6 

?  SOUAR  0.388  0.813 

SOUARED  BETA  WEIGHTS 
1.066  I ,7n9 
B  WEIGHTS 
-5.AS3  7,00* 

INTERCEPT  CONSTANT  •  5.5l 6 

3iaaai8aaii.iaisaiiaa<aaaaa.aa83iai3i»ii..ia3giiiiaii3asiaaaaaai3iiia33ai 

MULTIPLE  n  SOUARE  •  0.133 

MULTIPLE  R  ■  0.365 

N.O.F.l  «  3 

N.O.F.2  m  93 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  4.774 

BETA  WEIGHTS 
-1.006  1.241  0.0*1 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FACTOR  LOAoiNGSa  2NO  COLUMN) 
j  X  -0.2*8  0.676 

?  SOUAR  0.368  0.813 

3  X  CUBE  0.013  0.882 

SOUAREO  BETA  WEIGHTS 
1.012  1.579  0.O02 

B  WEIGHTS 

-5.313  6,64?  0,22* 

INTERCEPT  CONSTANT  ■  5.515 


ANOVA  TABLE  FOR  POLYNOMIALS 

«ii3««i«ai8i«aflet«>«tt3a8»a«tM3tai8«i3sia8a33aa««iia«««ittiiii3a«ts«i««i 

REDUCTION  due  to  LINEAR  FIT,  WITH  1  OF  ■  0.061 

RES IOUAL  S.S.  »  0.939  OF  ■  95  RESlOUAL  M.S.  m  0.010 

F  FOR  LINEAR  FIT  »  6.1&3 

sgtstaistasaaaasssiasssaaiaoaaaaaatBaaaaassaaatiaaaaaaaitaeiiaaaaiaaaaaias 

reduction  ouf  to  general  Quadratic  fit  with  of  2»  «  0.133 

REDUCTION  M.S.  »  0,067 

RESIDUAL  S.S,  ■  0.867  OF  ■  94  RESlOUAL  M.J,  ■  0.009 

F  FnR  QUADRATIC  FIT  a  7.238 

REDUCTION  OUF  TO  QUaoRATIC  TERM  ALONEt  WITH  l  CFa  ■  0.073 

F  FOR  QUADRATIC  TERM  ALONE  «  7*867 

■  iiiatimtaaaDiiiiiaiiaiMiaaiiiaiiiiaiaaiiaiiiaiaaaaattsaiiisutiaiaaaii 

REDUCTION  due  TO  GENERAL  CUBIC  EIT  WITH  OF  3*  -a  0.133 

REDUCTION  M.S.  ■  0,0** 

RESlOUAL  S.S.  »  0.867  OF  ■  93  RESlOUAL  M.S.  a  0.009 

F  FOR  OENERAL  CUBIC  FIT  ■  *.77* 

REDUCTION  DUF  TO  CUBIC  TERM  ALONE  WITH  1  OF  ■  ,  0,000 

F  FOR  CUBIC  TERM  ALONE  ■  0.000 


Bns3>i»ii-tJ3a:3n.riiiiai.-:3i4<ianiaifl^a3-ia3iu»':v^i3a3^i33B4niU30i|ii333«XB«8]aei{)ui3i 

POLYNOMIAL  flfTlNG  Fort  2  VARIAt?LES-GRE  anO  TP  SCOW?.  97  OBSEr/aT IOnS, 


THE  PREOICTOR  VaRIABLE(X)  IS  CRE,  AND  THE  CRITERION  VARtABLE'(Y)  1$  TP  SCORE# 

TEST  MEANS  ANO  STANOARO  deviations 


1  X 

0.960 

0.051 

2  SOUAR 

0. 924 

0.093 

3  X  CUBE 

0.891 

0.129 

4  Y 

6.000 

1.953 

CORRELATION 

MATRIX 

1  X 

1 .000 

0.999 

0.997 

0.301 

2  SQUAR 

0.999 

1.000 

0.999 

0.311 

3  X  CUBE 

0.997  - 

0.999 

1.000 

0.321 

4  Y 

0.301 

0.311 

0.321 

1  .000 

3iQ3i38i3D3ii3Si3iOacaa:a33B2ia3ii3aB33e3a3aiiiadi3sii3ai3ioilaiii|iiasi|| 

TTRSTt  SECOND'  ANO  TwIPO  DEGREE  POLYNOMIALS. 


0&S3iD3a3aiBBis3i383Ba833S>aaSDBiii3Bsas3iiaaaaiaas:iis9iaaiiiMiaaiaiaata 


MULTIPLE  R  SQUARE  ■  0.690 

MULTIPLE  R  ■  0.301 


N.O.F.l  ■  I 
N.O.F.?  a  95 

F  F OR  ANALYSTS  OF  VARIANCE  ON  R  a  9.435 

SETA  WEIGHTS 
0,301 

CONTRIBUTIONS  to  multiple  CORRELATION 

Ano  REGRESSION  FACTOR  LOaoINCS,  2ND  COLUMN) 
T  X  0,090  1.000 

SQUARED  beta  weights 
0.090 
8  WFIGHTS 

U  .507 

INTERCEPT  CONSTANT  ■  -5.043 


MULTIPLE  R  SQUARE  ■  0.154 

MULTIPLE  R  •  0.393 

N.O.F.l  a  2 
N.O.F.?  a  94 

F  FOR  ANALYSTS  OF  VARIANCE  ON  R  «  8.560 

BETA  WEIGHTS 
-5.585  5.891 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FACTOR  LOAOINGS,  2ND  COLUMN) 

T  X  -1  .679  0.700 

2  SOUAR  1.833  0.793 

SQUaREO  BETA  WEIGHTS 
31,196  34,7*7 

B  WEIGHTS 
213.818  123.123 

INTERCEPT  CONSTANT  ■  97.486 

aaiaiasaaaiSBaBBiaagiaaaaaiaaiaiaaaaaaaBaiaaaaiiiaBaaaaBaiasitiiRigiaSBiaa 

MULTIPLE  R  SQUARE  •  0.*2I 

MULTIPLE  R  •  0.470 

N.O.F.l  ■  3 

N.D.F.2  »  93 

F  FOR  ANALYSIS  OF  VAPIANCE  ON  R  •  8.794 

BETA  WEIGHTS 

137, 159-266. 609  139.994 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FAcTCR  LOaoINGS.  2NO  COLUMN) 

1  X  38.221  0.639 

2  SQUAiR  -82.947  0.662 

3  X  CUBE  44,947  0.603 

SQUARED  RETA  weights 


EM  RATING 


b  weights 

867. 907****4***21 17.681 
INTERCEPT  CONSTANT  a  -1400.053 


ANqVA  TABLE  FOR  POLYNOMIALS 

aaaBaaaaaaBaaaaeaaaasaaaaaaaBaaaaaiaaaaaaagaaaaiaaaaiaaaaaiaaaaaaaaiaaaaaa 

REDUCTION  due  TO  LINEAR  fit,  WITH  1  OF  a  0.090 

RESIDUAL  S.S.  a  0.910  OF  a  95  RESIDUAL  M.S.  a  0.010 

F  FOR  LINEAR  FIT  a  9,435 

. . in . . . . 

REDUCTION  DUE  to  GENERAL  QUAORATIC  FIT  WITH  of  2.  a  0.154 

REDUCTION  M.S.  ■  0.077 

RERIDIIAL  S.S.  a  0.846  OF  a  94  REsiOUAL  M.S.  4  0.009 

F  FOR  QUADRATIC  FIT  a  8.560 

REDUCTION  OUF  TO  CUadRATIc  TERM  ALONE.  WITH  1  CF.  a  0.064 

F  FDR  QUADRATIC  TERM  ALONE  a  7.081 

. . . . . . . 

REDUCTION  DUE  TO  GENERAL  CUBIC  FIT  WITH  OF  3.  a  0.221 

REDUCTION  M.S.  a  0.074 

RESIDUAL  S.S.  •  0.779  OF  a  93  RESIOUAL  M,j.  ■  0.008  1-5 

F  FOR  GENERAL  CUBIC  FIT  a  8,794 

REDUCTION  DUE  TO  CUBIC  TERM  ALONE  WITH  1  OF  •  ,  0,067 

F  FOR  CUBIC  TFRM  ALONE  a  7.987 

aaa8i«aanaoaiaaaaiia8naiasaao8aais>aaFQiiaaaiaaaaaiaiaaaaa«aiaaaR8a«aiiaaa 


EM  RATING. 


acsatiasaa  «-s 

PniYUflMlAl.  FTfTtwg  FOR  2  VAH  I  AOLim-rt'ie  ANO  Ti’  SCORE-  97  OBSEHV  A  f  I  DNS . 


THE  PREDICTOR  VA»I  AriLE  ( X)  IS  WRE,  AMO  THE'  CRITERION '  VapI  ABLE  (V)  ''  IS  TP  SCORE,  • .' 


TEST  MEANS  , 

AND  -STANDARD 

OBVIATIONS 

• 

.  '  . 

I  •'  X  . 

0,647 

'  0.1«5 

■ 

?  SQUAR 

0.453 

0.225 

3  X  CUBE 

0.333 

0.236 

4  Y 

6,000 

1.953 

CORRELATION 

matrix 

1  X 

1.000 

0,963 

0.918 

0.492 

2  SQUAR 

0.963 

1.000 

0.989 

0.30* 

3  X  CUBE 

0.910 

0.989 

1.000 

0  .481 

'  4  Y 

0.492 

0.50* 

0.48) 

1.000 

aaS3aB33BBXB833BB883aa3a 

isaaaaaaaeaaaaaaa: 

BasaaBBa8aa04BS3BB3«aB3Bxaa33aaaa 

FIRST,  SECOND.  AND  THI90  DEGREE  POLYNOMIALS, 

a8as3asaBisia33aaaa833Ba3*3aaaBBasa3:aa3i8ia33ialisDtasa3iaDlllBaD8ialiaai 


MULTIPLE  P  SQUARE  »  0.?*2 

MULTIPLE  »  ■  0.492 

N.O.F, j  ■  \ 

N.O.F,?  a  95 

F  FOR  ANALYSIS  OF  VARIANCE  ON  H  •  30045 

RFTs  WEIGHTS 
0,492 

CONTRIHUTIONS  to  multiple  correlation 

ANO  REGRESSION  FACTOR  LOAOINGSf  2ND  COLUMN) 

1  X  0,242  1,000 

SQUARED  beta  weights 

0.242 
R  WEIGHTS 
S.  194 

INTERCEPT  constant  a  2.639 

asBassessiaaaassaaaassassBasaaaBaassssisaiasasssaaaa aaaaiBaDiaaaaaaaaaaaaB 

MULTIPLE  R  SQUARE  »  0.?S4 

MULTIPLE  R  a  0,304 
N.O.E.l  a  ? 

N.O.F,?  a  94 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  16.024 

BETA  weights 

0.096  0.411 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  regression  EacTCR  LOADINGS.  2N0  COLUMN) 

T  X  0,047  0.976 

2  SQUAR  0.207  0.999 

SQUARED  BETA  weights 

0.009  0.169 

B  WEIGHTS 

1.012  3.S73 

INTERCEPT  CONSTANT  a  3«7?8 

3333SS3D3  3  S  9  2  3  »  =  a  9  S  3V3  3  *  3  33  3  *  3  a  »  B3  S  3  3  3  3  C  3  S  B  •  3  B  9  3  3  3  SI  3  a  3  a  I  3  3  B8  B  3  *  »  a  9  S  3  S  *  9  *  S  3  3  a 

MULTIPLE  R  SQUARE  »  0.3g0 

MULTIPLE  R  «  0.548 

N.O.E.l  a  3 
N.O.F, 2  a  93 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  13.273 
BETA  WEIGHTS 
-1,475  5.100  -3,210 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOAOINGS*  2ND  COLUMN) 

1  X  -0,726  0.899 

?  SOUAR  2,568  0.920 

3  X  CURE  -1.543  0.878 

SOUaREO  RETA  WEIGHTS 

2.176  26.012  10,307 

B  WEIGHTS 

-15,571  44.3)9  -26.861 

INTERCEPT  CONSTANT  a  9.86* 


ANOVA  TABLE  FOR  POLYNOMIALS 

laaaaBiBaBaaBaaaBaaaaaaaaiiSDiaaDaaasaaaaaaaaaaaiaaiaBaaaaaaBBBiiaaBaBaaaa 

REDUCTION  OUF  to  LINEAR  riT,  WITH  1  OF  a  0.242 

RESIDUAL  S.S.  a  0,758  OF  a  95  RESIDUAL  M.S.  a  0.008 

F  FOP  LINEAR  FIT  a  30.3*5 

■IDl233l3IDIIBlliaD|lllDOO*C|l3aD33DCI33llD3lDllQ33rl33lDOIII>lll3l3M3|3| 

REDUCTION  DDF  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2.  ■  0.234 

REDUCTION  M.S.  a  6.127 

RESIDUAL  S.S.  a  0.746  OF  a  94  RESIDUAL  M.S,  »  0.008 

F  FOR  QUADRATIC  FIT  a  16*024 

REOUCT ION  DUE  TO  CUAORATIC  TERM  ALONE,  WITH  1  CFf  a  0.012 

F  FDR  QUADRATIC  TERM  ALONE  a  1,53? 

. . . 

REDUCTION  OUF  TO  GENERAL  CUBIC  EtT  WITH  OF  3,  a  0.300 

REDUCTION  M.S,  a  0.100 

RESIDUAL  S.S.  a  0,700  OF  a  93  REStOUAL  M.S,  »  0,008  1-6 

F  FnR  GENERAL  CIIRIC  FIT  a  13.273 

REDUCTION  DUE  TO  CUBIC  TERM  ALONE  WITH  1  OF  ■  ,  0,044 

E  FDR  CUBIC  TFBM  ALONE  a  6,051 

. . . . . 


aRXnJaaBaaasssaaauaasBiasaDaaauvssaaavasQansissstx saniaBvaauiiBsna^aJM ^igga 

POLYNOMIAL  fitting  FOR  2  VAft  IAPLES-SPE  ANO  TP  SCOPE-  171  OBSERVATIONS, 


.  ;  ET  RATING 

THE  PREOICTOR  'vaRIarlEIX)'  IS  SRE,  ANO  THE  CRITERION  Var'IA8LE(Y1  IS  TP  ScoAC, 

TEST  MEANS  ANO  STANDARD  OEVIaTIONS 


1  X 

0.160 

0.208 

2  SQUAR  • 

0.671 

0.1*9 

3  X  CUBE 

0.0*0 

0.127 

4  Y 

6.514 

1.784 

CORRELATION  MATRIX 

1  X 

1.000 

0.909  0.778 

0.318 

2  SQUAR 

0,909 

1.000  0.963 

0.205 

3  X  CUBE 

0.770 

0.993  1.000 

0.126 

4  V 

0.318 

0.205  0.126 

1 .000 

BSB3Blll3B8Il333ailBB33BBa3B3BaUa83BaSB3aXB33S39B23Bia8BI3allaail8BB8B|l33|| 

FIRST,  SECOND, 

ANO  THIRQ 

DEGREE  POLYNOMIALS. 

MULTIPLE  R  SOHARE  a  0. 

1A1 

MULTIPLE  R  a 
N.O.F.l  a  1 

0.318 

N.0.F.2  a 

171 

F  FDR  ANALYSIS 

OF  VARIANCE  ON  R  ■  19.191 

BFTa  weights 

0.318 

CONTRIBUTIONS 

TO  MULtlPLE 

CORRELATION 

ano  regression  factor  loadings.  2no  column) 

1  X  0.101  1.000 

souareo  beta  WEIGHTS 

0.101 
8  WEIGHTS 
2.720 

INTERCEPT  CONSTANT  a  6,057 

■  (■3»aiaa>iii33,:3>igii:>ii>aa>:.:»>aaaiiia>iiaaa<iag.,aii»a,ii(3aiaiiIaa 

MULTIPLE  R  SOHARE  ■  0.1*2 

MULTIPLE  R  •  0.37S 

N.O.F.l  ■  2 

N.0.F.2  ■  176 

f  for  analysis  of  variance  on  r  ■  14.021 

BETA  WEIGHTS 
0.759  -6.405 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOaoINGS*  2ND  COLUMN) 
j  X  0.2*1  0.6*4 

2  SOUAR  ‘  -0.099  0.5*5 

SOUAREO  BETA  WEIGHTS 

0,576  6,235 

B  WEIGHTS 

6.498  -5.793 

INTERCEPT  constant  a  5.035 

oaaagaaaaaaaaaaaaaaaaaaaaa'aaaaaaaaataaaaaaaaaagaaataa.aaiiaaBaanoiaaaaai 

MULTIPLE  R  SOHARE  ■  0.1*2 

MULTIPLE  R  ■  0.377 

N.O.F.l  ■  3 

N.0.F.2  ■  169 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  9.323 

BETA  WEIGHTS 

0,8*5  -0.710  0.152 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOAOlNGSt  2N0  COLUMN) 

T  X  0.260  0.8*3 

2  SQUAR  -0,1*5  0.5*4 

3  X  CUBE  0.019  0.33* 

SOUaREO  BETA  WEIGHTS 

0.714  6.544  0,623 

B  WEIGHTS 

7.235  -fl.477  2.129 

INTERCEPT  CONSTANT  a  5.817 


ANQVA  table  FOR  polynomials 

.  . . . . . . . 

REDUCTION  OUF  TO  LINEAR  PtT,  WITH  1  OF  a  0.101 

RESIDUAL  S.S.  a  0.B99  OF  a  1 Tl  RE'SIOUAL  M.s,  a  0.005 

F  FOR  LINEAR  FIT  ■  19.191 

aaaaBaaaBaaagaaaaaaaaaigaaagaaaaaaaiaaaBaaaaagaaaiaaaaaaaiaaaagaagiaaaaaai 

REDUCTION  OIIF  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2.  a  0.142 

REDUCTION  M.S.  ■  0.071 

RFSinUAL  S.S.  ■  0.858  OF  a  170  RESIDUAL  M.s.  a  0.005 

F  FOR  QUADRATIC  FIT  a  14.021 

REOllCT ION  OUF  TO  QUADRATIC  TERM  ALCNEa  WITH  l  CFt  ■  0.041 

F  FDR  QUADRATIC  TERM  ALONE  ■  HaOSB 


REOiiCTION  OUF  TO  GENERAL  CUBIC  FIT  WITH  OF  3i  -a  0.142 

REDUCTION  M.S,  a  0.047 

RESIDUAL  S.S.  a  0.B58  OF  a  169  RESIDUAL  M.s,  a  0a005 

F  FOR  GFNERAL  CUBIC  FIT  a  9.323 

RFOIICTION  DUF  TO  CURIC  TERM  ALONE  WITH  l  OF  a  ;  0.000 

F  FnR  CUBIC  TFRM  ALONE  a  0,078 

BBSaiaiuiiiiiniiiiii 


aaea'i.*:,i[i3g3ir3an333g!iflna3c98jaajjaaji.Taaa3M333;333i'i.i8oara::isi,J»3'8  3oa(iaj«jan.i-ja 

POLYNOMIAL  FITTING  FOH  2  VAW I  AiiLES-PRE  ANO  TP  SCORE-  173  OBSERVATIONS. 

ET  RATING 

THE  PREDICTOR  VARIABLE(X)  IS  PRE.  ANO  ThE  CRITERION  VARIABLE (Y)  IS  TP  SCORE,. 


TEST  MEANS  ANO  STANOAHD  DEVIATIONS 
1  X  0.404  0,352 

?  SQUAR  0.207  0,208 

3  X  CUBE  0.213  0 ,240 

4  Y  6.S14  1.784 

CORRELATION  MATRIX 

I  X  1  . 000  0.967  0.904  0,366 

?.  SQUAR  0.967  1  . 000  0.98?  0.761 

3  X  CURE  0.904  0.982  1. 000  0.3*3 

4  Y  0.366  0.36I  0.343  I. 000 

.  . . . . . . . . . 

FIRST.  SECOND,  ANO  THIRD  DEGREE  POLYNOMIALS. 

. . . . . . . 

MULTIPLE  R  SQUARE  “  0.134 

MULTIPLE  R  a  0.366 
N.O.E.I  a  I 
N.D.E.2  a  I  7 1 

F  FOR  ANALYSTS  OF  VARIANCE  ON  R  ■  26.423 

BETA  WEIGHTS 
0.366 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  FacTCR  LOAOiNGSt  2N0  C0LUMN1 

1  X  0,134  I. 000 

SQUARED  beta  weights 

0.134 
B  WfIGHTS 
I.8S4 

INTERCEPT  CONSTANT  ■  5.765 

BaiaSssaaaaaazBaaBiaBaaaaaaiiBssaaaaaBBSBaisBaBSiaaBaaisaiiauaaBiBiBiiial 

MULTIPLE  R  SQUARE  ■  0.135 

MULTIPLE  R  »  0,367 

N.O.F.I  ■  2 

N.0.F.2  ■  176 

F  FOR  AN4LYSIS  OF  VARIANCE  ON  R  ■  13.222 

BETA  WEIGHTS, 

0.260  0.109 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOAOINGSt  2ND  COLUMN) 

T  X  0.09S  0.997 

2  SQUAR  0.039  0.904 

SQUARED  BETA  WEIGHTS 

0.068  0.012 
B  WEIGHTS 

I.3I9  6.677 

INTERCEPT  CONSTANT  a  5.787 

aaiaaaaaaaaBiasaBaasaaasaaaaiaaaaaaaaaaiaaaaaaaiaiBaiaaaaiaaaaiiiaiiiaiafla 

MULTIPLE  R  SQUARE  ■  0.135 

MULTIPLE  R  ■  0.367 

N.O.F.I  a  3 

N.O.F.2  a  169 

F  FOR  ANALYSTS  OF  VARIANCE  ON  R  a  8.769 

8ET A  WEIGHTS 

0.364  «6. 137  0.748  '  . . . 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOaoINGS.  2N0  COLUMN) 

T  X  0.133  0.997 

I,  SQUAR  -0.049  0.983 

3  X  CUBE  0,031  .  0.935 

SQUaREO  BETA  WEIGHTS 

0.133  0.019  0.622 

B  WEIGHTS 

1.845  -6.8*7  1.068 

INTERCEPT  CONSTANT  a  5;783 


ANqVA  TABLE  FOB  polynomials 

iiiaaBiia8BiBa8aaaaai8BBaiaiaiifliaiiaaiBaa8Baiaiiiiiiiiiiiiniiiii||g|llll 

REDUCTION  OUF  to  LINEAR  FIT,  WITH  1  OF  a  0.134 

RESIDUAL  S.S.  a  0.B66  OF  a  171  RESIDUAL  M.S.  ■  0.005 

F  FOR  LINEAR  FIT  a  26.423 

. . . . . . aaaaaai . . 

REDUCTION  OUF  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2»  a  0.133 

REDUCTION  M.S,  ■  0.067 

RESIDUAL  S.S.  a  0.865  OF  a  170  RESIDUAL  M.S.  a  0*003 

F  FOR  QUADRATIC  FIT  a  13.222 

REDUCTION  DUF  TO  QUADRATIC  TERM  ALONE*  WITH  I  CF*  a  0.001 

F  FOR  QUADRATIC  TERM  ALONE  a  0.152 

aaaaHaaaaiaaaaagaaaBiagaaaaaaaaaaiaiaaaiaaiaaiaaaa.aaaaaaiaaAaaaaiaiaiaaa 

REDUCTION  OUE  TO  GENERAL  CuBIC  FIT  WITH  OF  3,  ,  0.135 

REDUCTION  M.S.  a  0,0*5 

RESIOUal  S.S.  ■  0.863  OF  a  169  RESIDUAL  M.J,  a  0.005 

F  FOR  GENERAL  CUBIC  FIT  a  8.769 

REDUCTION  OUF  TO  CUBIC  TERM  ALONE  WITH  I  OF  ■  ,  0,000 

F  FQR  CURIC  TFHM  ALONE  a  0.017 

.  . . . . . 


POLYNOMIAL  FITTING  FDI<  2  VARlA^LES-ORE  ANO  TP  SCORE-  )73  OBSEBVAT  IONS, 


ET  RATING 

The  PREDICTOR  VARIABLE(X)  Is  ORE,  ANO  The  CRITERION'  VarIAHLE(Y) • is  TP  'SCORE.  • 


test 

MEANS 

AND  STANDARD 

DEVIATIONS 

1 

X  . 

0.8  64 

0.222 

2 

SOUAR 

0.796 

0.2*3 

3 

X  CUBE 

0,7*0 

0.272 

4 

Y 

6.51* 

1.70* 

CORRELATION 

MATRIX 

t 

X 

1.000 

0.960 

0.893 

0.100 

2 

SOUAR 

0.960 

1.000 

0.98* 

0.H2 

3 

X  CUBE 

0.893 

0.984 

1.000 

0 ,  *95 

4 

Y 

0.508 

0.512 

0.495 

I. 000 

.  . . . . . . . 

FIRST •  SFC0NO.  AND  THIRD  DEGREE  POLYNOMIALS. 

. . . . * . . . . 

MULTIPLE  R  SQUARE  ■  O.^B 

multiple  r  ■  o.soe 
n.o.f.i  »  T 

N.0.E.2  ■  I T I 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  59.470 

8FT i  WEIGHTS 
0,508 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

and  regression  factor  loadings*  2no  column) 

\  X  0.258  1.000 

SOUaRED  beta  WEIGHTS 
0.258 
R  WEIGHTS 
4.080 

INTERCEPT  CONSTANT  a  2.908 

. . . . . . . . a. . ills,, 

MULTIPLE  R  SOllARE  »  0.206 

MULTIPLE  R  ■  0.513 

N.O.F.I  ■  2 

N.0.F.2  a  170 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  30.763 
BETA  WEIGHTS 
0.209  6.312 

CONTRIBUTIONS  to  multiple  correlation 

ano  regression  factor  loadings.  2N0  column) 

1  X  0,106  0 .995 

2  SOUAR  0.160  0.993 

SOUaREO  BETA  weights 

0.044  6.097 

B  WEIGHTS 

1.676  2.274 

INTERCEPT  CONSTANT  a  3.255 

asaaaasaaaaaaaaaaasaaaaaaaaasaaaaaaaaaaaaasaaasasaaaaaaaaaaaaasaaaaaaaaaaa 

MULTIPLE  R  SQUARE  «  0 • 27 | 

MULTIPLE  R  ■  0.521 

N.O.F.I  ■  3 

N.0.F.2  a  169 

F  FOR  ANALYSIS  OP  VARIANCE  ON  R  »  20.966 

BETA  WEIGHTS 

2.199  -4,675  3.129 

CONTRIBUTIONS  to  multiple  correlation 

ano  regression  factor  loadings.  2nd  column) 

\  .X  1.117  0.97s 

2  SOUAR  -2,394  0.9&3 

•j  *  CUBe  1.549  0.950 

SQUARED  BETA  WEIGHTS 
4.837  21.8*9  9,788 

8  WEIGHTS 

17.664  -34.0P5  20,481 

INTERCEPT  CONSTANT  a  3.22? 


ANoVA  TABLE  FOB  POLYNOMIALS 

. . . . . . . . . . 

REDUCTION  DIIF  TO  LINEAR  FIT,  WITH  1  OF  a  0.258 

RESIDUAL  S.S,  a  0.7*2  OF  a  l 7 1  RESIDUAL  M,$,  a  0.004 

F  FDR  LINEAR  riT  a  59,470 

. . a . . . a . . 

REDUCTION  OUF  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2.  a  0,266 

REDUCTION  M.S,  a  0.133 

RESIDUAL  S.S.  a  0,73*  OF  a  170  RESIDUAL  M.s,  a  0.004 

E  FOR  QUADRATIC  FIT  a  30.763 

REDUCTION  DUE  TO  CUApRATIC  TERM  ALONE.  WITH  1  rF .  a  0.008 

F  FOR  QUADRATIC  TERM  ALONE  a  1.783 

. . . a . a . Baaaaaa 

REDUCTION  due  TO  OEnFRAL  CUBIC  FIT  WITH  Of  3.  a  0,271 

REDUCTION  M.S.  a  0.090 

RESIDUAL  S.S.  »  0.729  OF  a  169  RESlOUAL  M.S,  •  0.004 

F  FoR  GFNERAi.  CUBIC  FIT  a  20.966 

RFOUCT I  ON  PDF  TO  CUBIC  TERM  ALONE  WITH  1  OF  •  0.001 

F  FOR  CIJRIC  TFRM  ALONE  a  1,274 


■  uaaBsaaananacnannuaiBjxi-'taaaaaaana  «s3i:iaR;aiBi9a8irta»i}BKiiiaafliamxii  a  a  B3a 

POLYNOMIAL  F  f  TT  t  NO  FOR  2  VARIAHLES*WRE  ANO  TP  SCOPE.  17.1  OBSERVATIONS, 


THE  PREDICTOR  VaRIARLE(X)  ts  WRE/ANO  THE- CRITERION  VARlAPiLE(Y) 


ts  TP ‘SCORE, 


ET  RATING 


TEST  MEANS  ANn  STANOaRO  OEVIaTIONS 


1  X 

0.873 

0.210 

2  SOUAR 

0.372 

0.225 

1  X  CUBE 

0.259 

0.207 

A  Y 

6.514 

1.784 

CORRELATION 

matrix 

1  X 

1.000 

0.977 

0.932 

0.445 

2  SOUAR 

0.977 

1 .000 

0,987 

0.413 

1  X  CUBE 

0,93? 

0,907 

1,000 

0.300 

A  Y 

0.445 

0,413 

0.380 

I.oOO 

•  :3,ca3,ri:i33s333i»iii:9iia>3i:>3<*i:93::3]„3]3 

FIRST,  SECOND,  aNO  TmI«0  nEOREE  POLYNOMIALS. 


.  . . . 

MULTIPLE  R  SOIIARE  ■  0.198 

MULTIPLE  R  ■  0.445 

N.O.F.l  ■  i 
N.0.F.2  ■  1 7 1 

F  Fnfl  ANALYSIS  OF  VARIANCE  ON  fi  ■  42.260 

8ETa  WEtflHTS 
0.445 

contributions  to  multiple  correlation 

and  REGRESSION  FacTCR  LOADINGS#  2ND  COLUMN) 

T  x  0,190  l.ooo 

SOUARED  BETA  WEIGHTS 
0.198 
R  WEIGHTS 
3.789 

INTERCEPT  CONSTANT  a  4.344 

. . . 

MULTIPLE  R  SOIIARE  a  0*^9 
MULTIPLE  R  »  0*4 57 

N.O.F.l  a  2 
N.O.P.2  a  170 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  22.416 

BETA  WEIGHTS 
0.913  .0.479 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOADINGS*  2ND  COLUMN) 

)  X  0.406  0.9/4 

?  SOIJAR  -0.198  0  # 904 

SQUaREO  BETA  WEIGHTS 
0.833  0.2P9 

B  wfights 

7.769  -3.BA2 

INTERCEPT  CONSTANT  a  3.478 

■saB3ai»sflBBi-s=aRiaaais3ia3aiBiaaaasaa:aaiai3iiaiBi8RB3a»siaiii8i33iiaia 

MULTIPLE  R  SOIIARE  ■  0.^10 

MULTIPLE  R  a  0.458 

N.O.F.l  a  3 
N.O.F.2  a  169 

F  FOR  ANALYSTS  OF  VARIANCE  ON  R  ■  U.942 

BETA  WEIGHTS 

1.285  -I ,149  '  0.534 
CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  OEGRESSION  FacTCR  LOADINGS*  2NO  COLUMN) 
j  X  0.572  0.972 

2  SQUAR  -0.565  0.902 

3  X  CUBF  0.203  0  g  830 

SOUARED  BETA  WEIGHTS 

1  . 651  1,875  0,?8S 

b  weights 

10.937  -10,877  4,602 

INTERCEPT  CONSTANT  •  3,  Io3 


ANQVA  table  for  POLYNOMIALS 

RtBBataastBaa:BBa3tBB8*aBaR8SB*tBBBsa8R*aaBtBaaaaaBBaaaatB88iaBBaaaBaasaiaBaBt8aaav 

REDUCTION  due  TO  LINEAR  FIT,  WITH  I  OF  ■  0,196 

RESIOUAL  S.S,  ■  0,802  OF  a  1 7 1  RESIDUAL  M,S,  a  0,005 

F  FOR  LINEAR  FIT  a  42.260 

■  ■,,i,9,9>i>ii,i,999iaica99aiiii99aiiaii„,9a,,,,l,ii9,,l,,„„„,1il,l,a, 

PEnUCTlON  DUE  TO  GENERAL  QUADRATIC  FIT  WITH  DF  2,  a  0,209 

REOllCT  ION  M.S,  ■  0,10* 

RESIOUAL  S.S.  a  0,791  DP  a  170  REStDUAL  M,S,  ■  0*005 

F  FOR  Ol  I  ADR  AT  I C  FIT  ■  22*416 

REDUCTION  DUE  TO  CUADRATIC  TERM  ALONE*  WITH  I  cE*  ■  O.Oll 

E  FOR  Oil  ADR  AT  I C  term  ALONE  a  2*261 

. . . . * . . . . . . 

REDUCTION  ONE  to  OEneRal  CU8IC  FIT  WITH  OF  3*  m  0.210 

REDUCTION  M.S,  a  0 , 070 

RESIDUAL  S,S.  a  0,790  DE  •  169  RESIDUAL  M,J,  a  0*005 

E  FOR  GENERAL  CUBIC  FIT  a  14.942 

REDUCTION  DUE  TO  CUBIC  TERM  ALONE  WITH  1  Or  •  ,  0,001 

F  FOR  CUBIC  T*BM  ALONE  ■  0,204 

aaaBaaaaaaaaaiiaaa488Baa)i*iia8iaa9aa89?aiiaiia8iMiiiiaaaiaaaMiiaiiaaaaHi 


■  rsnassnsaunn-a-jflSSBa-JttSfasauaxjaRasjsJttBajaQtcxaazxixcsaaasflisiKaiiisiaasuijaciaiiBBsa 

PDI  YNOM I AL  FITTING  par  2  VARIAULES-SrE  AND  TP  SCORE.  ISA  OBSERVATIONS, 

FT  RATING 

THE  PfiEOICTOR  VARIABLE ( X)  IS  SRE*  ANO  THE  CRITERION  VARIABLES)  IS  TP  SCORE,- 

TEST  MEANS  ANn  STANDARD  DEVIATIONS 


l  X 

0  a  303 

0.293 

2  SQUAR 

0.177 

0«255 

3  X  CUBE 

0.124 

0*231 

A  Y 

6,240  ■ 

2.042 

CORRELATION 

matrix 

1  X 

1.000 

0.944 

0.871 

0.346 

2  SQUAR 

. 0.R44 

1.000 

0.981 

0.322 

3  X  CUBE 

0,871 

0.981 

1.000 

0.294 

4  Y 

0.346 

0.3*2 

0.294 

1  .000 

i,3,i93isai„c3:iia33ii3„s,3iog9,,a,„iE,iiii:„go,iaag,aa,i>„la,aaiai,ll 

EIRST,  SECOND,  AND  THIRD  nfOREE  POLYNOMIALS, 

'  ic8338i83ifliaasas8iia8isa>aBiiiacaBai893iaiaiaa8iiaaniaaiaiaai«iaa>8iiiii 

MULTIPLE  R  SOUARE  ■  0,119 

MULTIPLE  R  ■  0,346 

N.D.F.l  ■  I 
N.0.E.2  a  152 

F  FOR  ANALYSIS  OF  Variance  ON  ft  «  20,623 

BETA  WEIGHTS 
0.346 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  EacTCR  lOaoINGS.  2N0  COLUMN! 

1  X  0.119  1,000 

SOUaREO  beta  HEIGHTS 

0.119 
B  WfIGHTS 
2.410 

INTERCEPT  CONSTANT  ■  S,5o9 

asB3:ii8ais8oasseaaiiii:sai838agsss8:iaisaiia8i38ii8ii:inaRgaiiai|i|||ia8 

MULTIPLE  R  SQUARE  ■  0.120 

MULTIPLE  R  a  0,346 

N.D.F.l  a  2 
N.0.E.2  a  1 S l 

F  FOR  ANALYSTS  OF  V4RIANCE  ON  R  ■  10.259 

beta  WEIGHTS 
0.382  >0.038 

CONTRIBUTIONS  TO  MULTIPLE  correlation 

aNO  REGRESSION  EacTCR  LOaoINGS,  2NO  COLUMN! 

\  X  0,132  0,999 

2  SOUAR  -0,012  0.932 

SOUaREO  BETA  WEIGHTS 

0.146  0.001 

B  WfIGHTS 

2,663  -6.307 

INTERCEPT  CONSTANT  a  5.4B7 

seaaaasaaaiasaiaBaiiiiaaiiiiaasseaaaiaasRaaiaisaaaiafliaaiiasiiisaisigaiaia 

MULTIPLE  R  SQUARE  ■  0.120 

MULTIPLE  R  ■  0.346 

N.D.F.l  ■  3 

N.D.F.2  a  ISA 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  0  6.798 

BETA  WEIGHTS 

0,339  0.6s3  -0.683 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

A NO  REGRESSION  FAcTCR  L^AOlNGSi  2NO  COLUMN) 

1  X  0,117  0.999 

2  SOUAR  0,027  0.932 

3  X  CUBE  -0,024  0.850 

SQUARED  beta  weights 

0,115  0.667  0.007 

B  WEIGHTS 

2.364  6.665  -0,730 

INTERCEPT  CONSTANT  a  5:495 


ANoVA  TABLE  for  polynomials 

Bca383BaaiiiaBSBia3aiaaagca8BaB89iia9aBaaaaa9aa9aai.RaBaaaaialaaiailaiaaai 

REDUCTION  DUF  TO  LINEAR  FIT,  WITH  1  OF  a  0.119 

RESIDUAL  S.S.  a  0.881  OF  a  152  RESlOUAL  M.s,  a  0.006 

F  FnR  LINEAR  pit  •  20.623 

. . . . . 

REDUCTION  OUF  To  GENERAL  QUaORATIC  FIT  with  OF  2,  a  0.120 

REDUCTION  m.s.  a  0.060 

RESIDUAL  S.S.  a  0.880  DF  a  151  RESIDUAL  M.S,  a  0.006 

F  FDR  QUADRATIC  FIT  .  10,259 

REDUCTION  DUE  TO  QUADRATIC  TERM  AL0NE»  WITH  1  rFi  a  0.000 

F  FDR  QUADRATIC  TERM  ALONE  ■  0.02? 

iiBBaaaaiiaaBaaaiiiiiaBiaBiaiaaaaaiaaaaaiaaaaaaaaaaiaaiBiaaiasaiaiiaaaaiia 

REDUCTION  DUF  TO  GENERAL  ?UBIC  FIT  WITH  OF  3i  a  0,120 

reduction  m.s,  a  o,040 

RESIDUAL  S.S.  a  O.BaO  OF  a  150  RESlOUAL  M.S,  »  0.006 

F  FOR  GENERAL  CUBIC  FIT  a  6.798 

REDUCTION  DUE  TO  CUBIC  TERM  ALONE  WITH  1  OF  ■  ,  0,000 

F  FOR  CUBIC  TFPM  ALONE  a  0.010 

. . . . . 


B33aanr.a  os 


:2'.M3  33aBfloBi3i35fli«e*axi'Ja*anji33aoJ*aa»a8<JC388siiifl3ii3a33ian3a 
POLYNOMIAL  FITTING  FOR  2  vARIAbLLS-PRt  ANO  TP  SCORE-  15*  OBSERVATIONS. 


FT  RATING 


the  predictor  variarleix)  is  pre,  ano  the  criterion  variableiyi  is  tp  score. 


TEST  MEANS  ANn  STANOaRO  OEVIaTIONS 


I  X 

0.565  0.393 

?  SOUAR 

0.476  0 .399 

3  X  CUBE 

0.410  0.347 

4  Y 

6.?4o  2.042 

CORRELATION  MATRIX 

1  X 

1.000  0.976 

0.931 

0.264 

2  SOUAR 

0.976  1.000 

0.987 

0.296 

3  X  CUBE 

0.931  0.987 

1.000 

0.312 

4  Y 

0.?64  0.296 

0.312 

1.000 

8SSS3333833BSS 

383898333=8333133333838 

333Cars3=338l3S9l 

FIRST,  SEC0NO, 

ano  third  Degree  polynomials. 

838:3881831338 

3X3t8g8l333&83giS33l888 

. . . 

MULTIPLE  R  SOUARE  ■  0.0^0 

MULTIPLE  R  a 

0*264 

N.O.F.l  a  I 

N.D.F.2  ■ 

192 

F  FOR  ANALYSIS 

of  variance  on  r  » 

11*394 

BET/i  WEIGHTS 
0.26* 


CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOADINGS!  2N0  COLUMN) 

T  X  0.070  1.000 

SOUAREO  BETA  WEIGHTS 
0.070 
B  WEIGHTS 
1  .372 

INTERCEPT  CONSTANT  a  S.460 

. . . . . 

MULTIPLE  R  SOUARE  ■  O.loO 
MULTIPLE  R  <•  0.317 

N.O.F.l  a  ? 

N.0.F.2  a  1 S I 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  0.408 

BETA  WEIGHTS 
-0,524  6.0*7 

CONTRIRUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  L°A0INGSi  2ND  COLUMN) 

T  X  -0.138  0.034 

7  SOUAR  0.239  0.934 

SOUaREO  BETA  WEIGHTS 
0.275  6 .652 

B  WEIGHTS 
-2.724  4.5 Pfl 

INTERCEPT  CONSTANT  a  5.63S 

. . . 

MULTIPLE  R  SOUARE  a  0.16* 

MULTIPLE  R  •  0.322 

N.O.F.l  a  3 
N.D.F.2  a  150 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  5.78* 

BET*  WEIGHTS 

0.394  -1.375  1.303 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOaoINGS*  2N0  COLUMN) 

T  X  0.104  0 ,020 

2  SOUAR  -0.407  0.918 

j  X  CUBE  0.406  0.968 

SOUAREO  BETA  WEIGHTS 
0.155  1,092  1,697 

B  WEIGHTS  " 

2.040  -7.699  7,657 

INTERCEPT  CONSTANT  a  5,606 


ANoVA  TABLE  for  POLYNOMIALS 

.  . . . . . . . 

REDUCTION  OtlE  TO  LINEAR  FjT,  WITH  1  OF  a  0,070 

RESIDUAL  S.S.  a  0.930  OF  a  152  RESIOUAL  M.S.  a  0.006 

F  FOR  LINEAR  EJT  a  11,394 

B883838B333883IBIiai38l3Baa||IBa8lB38aiBSaB8i8aBII3Kll33Blialtla||||g|gggg 

reduction  ouf  to  general  ouaoratic  fit  with  of  2,  •  0.100 

REDUCTION  M.S.  a  0.050 

RESIDUAL  S.S,  a  0.900  OE  ■  151  RESIOUAL  M,S,  ■  0.006 

F  FOR  OUAORATIC  FIT  a  0.400 

REDUCTION  DUE  TO  CUAORATIC  TERM  ALONE i  WITH  1  CF.  a  0.030 

F  FDR  OUAORATIC  TERM  ALONE  a  S.114 

at . . . . . . . . . 

RfDllCTION  DUF  TO  GENERAL  ?UBIC  FIT  WITH  OF  3*  a  0,104 

REDUCTION  M.S,  a  0.035 

RESIOUAL  S.S.  «  0.896  OF  »  150  RESIOUAL  M,J,  •  0.006 


F  FOR  GFNERAI.  CUBIC  FIT  a  5,784 

REDUCTION  DIJF  TO  CUBIC  TE«M  ALONE  WITH  1  OF  ■  , 

F  FOR  CUBIC  TFRM  ALONE  a  0.502 

8Baia88i88i8ii888i8i5iaBDBliiBBas88iiriaa8iiaai 
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0,003 


naaMas^atiaaaras.jEj^M'-t'SscaSfiaattaagsaszrcaxwacaaaasaaarstJaasiajBaBaaaciaflaaxaanaaa^ 
POLYNOMIAL  FITTING  pop  2  VARTAOLES-GRE  ANO  ip  score-  ISA  CHSEOVATionS 


FT  RATING 

the  preoigtor  variarleix)  is  ore, .and  the  criterion  vaoiableiY)  is  tp'scqrev 

TEST  MEANS  ANO  STANOARC  DEVIATIONS 


1 

X 

0.932 

0.071 

2 

SOUAR 

0.873 

0.125 

3 

X  CUBE 

0.822 

0.170 

4 

Y 

6.240 

2.0*2 

CORRELATION 

MATRIX 

1 

X 

1.000 

0.997 

0 .99  i 

6.374 

2 

SOUAR 

0.997 

1.000 

0.998 

.  0.380 

3 

X  CUBE 

0.991 

0.998 

1.000 

0.3B2 

4 

Y 

0.374 

0.380 

0.382 

1.000 

BsasrsiiiissgjjiiiiaiissaiassiossBiaBSougsriDsiaijiioniaatniiituauii 
FIRST,  SECOND,  ANO  THIRD  DEGREE  POLYNOMIALS, 

caaaa:aBaagao„i:iaa3iaBiaaaggaiaaa„ia3aigga]agaaio,ii,|3ia,ie,ia3,,,|,a, 

MULTIPLE  R  SQUARE  »  OiHO 

MULTIPLE  R  »  0 • 37A 

N.O.F.I  ■  T 

N.D.F.2  ■  152 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  24.72J 

beta  WEIGHTS 
0,374 

CONTRIBUTIONS  to  multiple  correlation 

And  regression  factor  loadings*  2no  column) 

T  x  0.140  i.ooo 

SOUAREO  beta  weights 
0.140 
B  WFIGHTS 
10.818 

INTERCEPT  CONSTANT  »  -3^840 

o:n-33ia3i:i3;i3aaaa]a::;:a3aaaiaiaaiaaiiiaal:aaaaailaaiilliall:iiii„,I|, 

MULTIPLE  R  SQUARE  »  0.H8 

MULTIPLE  R  ■  0.3BS 

N.O.F.I  a  2 
N.O.F.2  ■  I5i 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  13.1S6 

BETA  WEIGHTS 
-0.826  i «  304 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOaoINGSi  2N0  COLUMN) 
j  X  -0.34ft  0  .9  Tl 

2  SOUAR  0.495  0.96s 

SOUaREO  BETA  weights 
0.858  1 ,699 

R  WFIGHTS 
-26 .793  21.215 

INTERCEPT  CONSTANT  ■  12.681 

asflaoassaioiasaaoiassSBasaaaaaaassaicasasieaiaiaaiaaiiissniilaaiiaiaaiaii 

MULTIPLE  R  SQUARE  ■  O.I«5 

MULTIPLE  R  ■  0.406 

N.O.F.I  ■  3 

N.O.F.2  a  150 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  9.871 

BETA  weights 

-24.807  52.818  -27.746 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOAOlNGS.  2N0  COLUMN) 

J  X  -9.278  0.921 

2  SOUAR  20.050  0.935 

3  X  CUBE  -10,607  0.942 

SOUaREO  BETA  WEIGHTS 
615.3702789.744  769.824 

b  weights 

7)7.524  859.598-334,275 
INTERCEPT  CONSTANT  a  199,144 


ANqVA  TABLE. FOR  polynomials 

. . . 

REDUCTION  DIIF  TO  LINEAR  FIT,  WITH  1  OF  B  0.140 

RESinUAL  S.S.  a  0.860  OF  a  152  RESIDUAL  M.S.  ■  0.006 

F  FOR  LINEAR  FIT  •  24.721 

asaaaaBaaaaaaaaaaaaaaaaaaaaaaaaaaacaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa 

REDUCTION  OUF  to  general  QUADRATIC  FIT  WITH  of  2.  a  0.148 
RFOUCTION  M.S.  ■  0.074 

OFSIOUAL  S.S.  a  0.852  OF  ■  151  RESIOUAL  M,J,  a  0.006 

F  FOR  OUAORAT1C  FIT  a  13,156 

RFOUCTION  OUF  TO  CUAnRATIC  TERM  ALONE.  WITH  1  Rp •  a  0.009 

F  FnR  QUaORaTIC  TERM  ALONE  a  1.508 


RFOUCTION  OUE  TO  GENERAL  CUBIC  FIT  WITH  OF  3*  a  0,165 

REDUCTION  M.S.  a  0.055 

RESIDUAL  S.S.  »  0.83®  OF  a  ISO  RESIDUAL  M,S,  a 

F  FdR  GENERAL  CURIO  rIT  a  9.871 

RFOUCTION  DUF  TO  CUBIC  TERM  ALONE  WITH  1  OF  ■  ,  0.016 

F  FOR  CUBIC  TFRM  ALONE  a  2.959 

a  ■  a  a  ■  ■  ■  it  a  a  a  ■  a  ■  «  «  s  o  m  a  ■  ■  ■  b  a  ■  ■  ■  a  ■  m  a  a  a  ■  a  ■  ^  ■  g  ■  a  q  3  a  ■  a  a  s  ■  ■  ■■  a  3 1 


0*006 
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0  3saS39ss3osa.ifl'4a8iBBia38S0isaflcsixaBBissss3lisa9i3u:aiiiaBi«sI9  8«iissaii)asat 

POLYNOMIAL  PITTING  Ff)R  2  VAHIA«LES-WRE  anO  TP  SCOPE-  154  OBSERVATIONS, 


FT  RATING 

THE  PREDICTOR  VARIABLES)  IS  WRE ,  ANO  THE  CM  T£R  I  ON  VAR  I  ABLE  <Y  I  IS  TP  SCORE. 

TEST  MEANS  ANO  STANDARD  OEVIATIONS 


1  X 

0.620 

0.190 

?  SOUAR 

0.420 

0.218 

3  X  CUBE 

0.300 

0.211 

4  Y 

6.240 

2.062 

CORRELATION 

MATRIX 

1  X 

1.000 

0.970 

0.919 

0.430 

2  SQUAR 

0.970 

1 .000 

0.986 

0.388 

3  X  CUBE 

0.919 

0.986 

1.000 

0.344 

4  Y 

0  .430 

0.388 

0.344 

1.000 

csasi3Bi33s  sssssiiaBsBass&a^aBsaaiasasaisnaBssaaiaaiBBsiiBsaaaaiaiingaag 

FIRST,  SECONn,  ANO  ThIRO  (SEGREE  POLYNOMIALS, 

siisiliBciBiasassasBBsa&aiBaaiitaaiiaaaasaaatsaoaastisasaitsMsitisatiaQiia 

MULTIPLE  R  SOUARE  ■  0,1^5 

MULTIPLE  R  »  0.430 

N.O.F.l  •  i 
N.O.F.z  »  152 

E  FoR  ANALYSTS  OF  VARIANCE  ON  R  »  34,332 

beta  weights 

0  ,  A  30 

CONTRIBUTIONS  to  MULTIPLE  CORRELATION 

ANO  REGRESSION  factor  LOADINGS*  2NO  COLUMN! 

T  X  0.185  1.000 

SOUaREO  BETA  WEIGHTS 
0.185 

B  weights 

4.635 

INTERCEPT  CONSTANT  ■  .  3*366 

■sar&ssiiisa ssssiaaiaiascaassasaaaaasaaacasaasaaisaaaaiaaaaaaaaaaaaaaaaiia 

MULTIPLE  R  SOUARE  ■  0.?fl0 

MULTIPLE  R  «  0.448 

N.O.F.l  «  2 

N.0.F.2  ■  151 

p  for  analysis  of  variance  on  R  *  ia.9o7 
BETA  WEIGHTS 
0.923  -6.508 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  FacTCR  l9aoINGSi  2ND  COLUMN! 

1  X  0,397  0.961 

?  SOUAR  -0,197  0.866 

SOUAREO  BETA  WEIGHTS 
0.852  6.258 

8  WEIGHTS 

9.943  -4,81? 

INTERCEPT  CONSTANT  a  2*Io5 

.  . . . 

MULTIPLE  R  SOUARE  ■  6.2fi4 

MULTIPLE  R  »  6 .451 

N.O.F.l  »  3 

N.D.F.2  »  150 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  »  12*786 

BETA  WEIGHTS  ....  ..  . . . . 

0.328  0.9«4  -0,928 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FACTOR  LOaoINGS*  2NO  COLUMN! 

\  X  0.141  0.953 

?  SOUAR  0,382  0.859 

1  X  CU8C  .  -0.319  0.762 

SOUAREO  BETA  WEIGHTS 
0.107  0.969  0.861 

B  WEIGHTS 

3.531  9.165  -8.994 

INTERCEPT  CONSTANT  «  2.811 


ANfjVA  TABLE  FOR  POLYNOMIALS 

. . . . . . . 

PEnUCT  ION  OIIE  TO  LINEAR  FiT»  WITH  1  OF  ■  0.185 

PESIOUAL  S.S.  »  0.815  OF  «  is2  RESIOUaL  M.S.  »  0.003 

F  FOR  LINEAR  FIT"  34,532 

. . . . . . 


REDUCTION  nue  TO  general  QUAORATIC  FIT  WITH  OF  2*  ■  0,200 

REOllCT ION  M.S,  ■  0.100 

PFSIDUAL  S.S,  »  0*800  OF  a  151  RESjOUAL  M.S.  a 

F  FrtR  OllAORATIC  FIT  a  I8;907 

REDUCTION  OUE  TO  QUADRATIC  TERM  ALONE*  WITH  1  oF*  a  0.015 

F  FOR  QUAORATIC  TERM  ALOnE  a  2.860 

. . . . . . . 


0*005 


REDUCTION  DUE  TO  GENERAL  CUBIC  FIT  WITH  OF  3*  a  0.204 

REDUCTION  M.S.  ■  0.068 

RESIOUAL  S.S.  a  0.796  OF  »  150  RESIOUAL  M.S.  a  0.003  1-14 

F  FoR  GENERAL  CUBIC  FIT  a  12.786 

REOIICTION  DUF  to  CUBIC  TERM  alone  WITH  1  OF  a  ,  0.003 

F  FOR  CUBIC  TFRM  ALONE  a  0.635 


30»BEsn<iB»3ii'ja<ifl«3a3ro3  =  s3»n)i«ax»ti»3i:ii»->!»!»3n»a»»»at»3JS*aa»«»a«»3»«o»aOaa«« 
POLYNOMIAL  FITTING  FQH  2  VARIABLES-SRE  AND  TP  SCOPE-  58  OBSERVATIONS. 


IC  RATING 

THE  PREDICTOR  VARIarlE(X)  IS  SPE*  ANO  THE  CRITERION' VARIABLE <Y)  iS  TP.  ScORE,' 


TEST  MEANS 

AND  STANDARD 

DEVIATIONS 

1  X 

0  »?66 

0.280 

?  SQUAB 

0.1*8 

0.2^0 

3  X  CUBE 

0.096 

0.189 

4  Y 

5. S5? 

2.371 

CORRELATION 

matrix 

1  X 

1.000 

0.941 

0.846 

0.361 

?  SQUAR 

0.941 

1.000 

0.971 

0.345 

3  X  CUBE 

0 .846 

0.973 

1.000 

0.309 

4  Y 

0.361 

0.345 

0 . 3o9 

l.noo 

3D3a3ocio3i3nnaai3i3n=s333>iioiEC3i33iiiia32iaii333aiiioiiinaniiaiiaa3iai 

FIRST  t  SECOND •  ANO  THIRO  n EG»EE  PULYNOM I ALS  * 

■  Dl3a8:33ll8GB8CII303Sia3>lllOOiall3e338llB3lianiaill3aaUIU«lll8lltBBBa 

MULTIPLE  R  SOIIARE  a  0.131 
MULTIPLE  R  ■  0.361 

N.O.F.l  •  ) 

N.O.F.?  a  56 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  8.*o7 

BETA  WEIGHTS 
0,361 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FAcTCR  LOADINGS.  2N0  COLUMN) 

T  X  0.131  1.000 

SQUARED  BETA  WEIGHTS 
0.131 
B  WEIGHTS 
3.062 

intercept  constant  a  4.738 

Banaaasaaaaasaisaaaaaassaaaasaiaiaaaiaaaaiia.saaaisaaBasaiiaiiiiBasaiiBaaa 

MULTIPLE  R  SQUARE  *  0.131 

MULTIPLE  R  *  0.362 

N.O.F.l  a  j 
N.O.F.2  a  55 

F  FOB  ANALYSIS  OF  VARIANCE  ON  R  »  4.136 

BETA  WEIGHTS 
0.320  0.044 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  FacTCR  LOAOiNGS.  2ND  COLUMN) 
f  X  0.116  0.998 

?  SQUAB  0.015  0.954 

SQUARED  BETA  WEIGHTS 
0.102  6,002 
b  weights 

2.711  6.474 

Intercept  constant  a  4.761 

■  >3igEgiaiaii3i!ai39.i3>:i>aii9a9iii9iaiilial>aM.ii<a3ia«»«Uiia«a>iii 

MULTIPLE  R  SQUARE  •  0al33 

MULTIPLE  R  a  0a36i 

N.O.F.l  a  i 
N.O.F.2  a  54 

F  FoR  ANALYSTS  OF  VARIANCE  ON  R  a  2.755 

BETA  WEIGHTS 

0.063  0.69P  -0.423 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOAOlNGSt  2ND  COLUMN) 
j  X  0,023  0.992 

2  SOUAR  0.241  0.947 

3  X  CUBE  -0,131  0,847 

SQUARED  BETA  WEIGHTS 

0.004  0.4B7  0,179 

B  WFIGHTS 

0.334  7, BOO  -5,306 

INTERCEPT  CONSTANT  a  4,814 


ANQVA  TABLE  FOR  POLYNOMIALS 

■aaaaiaaaaiaasataaa.aaiaaaaaaiiiiaiaaaia.aiaaiaaaiaiaaiaiaaaaaaaaaaaiaiaaa 

REnUCT ION  OlIF  TO  LINEAR  FIT.  WITH  1  OF  a  0al31 

PESIOUAL  S.S.  «  0.869  OF  a  56  RESlOUAL  M,$,  a  0.016 

F  FOR  LINEAR  ETT  ■  8.407 

■Bieauaaaaii.aiaaaiaaigiaaiiataaaiaaiaiaaaaaiataiaaataaaaaaaaaaiiaaiataaa 


REDUCTION  DUE  TO  GENERAL  CUAORATIC  FIT  WITH  OF  2*  a  0al3l 

REDUCTION  M.S.  ■  0.065 

RESIDUAL  S.S.  a  (1.869  OF  a  55  RESlOUAL  M.S,  a  0.616 

F  FOR  QUADRATIC  FIT  a  4.136 

REDUCTION  OUE  TO  OUAORATIC  TERM  ALONEi  WITH  1  C^a  •  0,000 

F  FnR  QUADRATIC  TERM  ALONE  a  OaOl* 

iiBaisBiaaatB3iaiBBtiflB33i>iiBSiai»fliiBiBBi9iif  9tiaoai*itaisaaaaaitit< 


REDUCTION  OUE  TO  GENERAL  CUBIC  FIT  WITH  OF  3.  0.133 

RFOUCT I  ON  M.S.  a  0.044 

PESIOUAL  S.S.  a  0.B67  OF  a  54  RESlOUAL  M.J,  a  0a0l6 

F  FnP  GENERAL  CUBIC  FIT  a  2.755 

REDUCTION  OUF  TO  CUBIC  TERM  ALONE  WITH  1  OF  ■  ,  0.00? 

F  FOR  CUBIC  TFBM  ALONE  a  0.125 


1-15 


POLYNOMIAL  pitting  for 


2  VARIAOLES-PRE  AND  IP  SCOPE 


50  OBSERVATIONS 


the  predictor  variable (x>*  IS'  pre,  ano  the  criterion  var^hleiy)  is'tp  score.- 


IC  RATING 


TFST 

MEANS  , 

AND  STANDARD 

DEVIATIONS 

1 

X 

0.508 

0.399 

2 

SOUAR 

0.*1* 

0.3*5 

1 

X  CUBE 

0.350 

0.3*1 

* 

Y 

5.552 

2.371 

CORRELATION 

MATRIX 

l 

X 

1,000 

0.976 

0.936 

0.322 

2 

SOUAR 

0,976 

'  1.000 

0.989 

0.330 

3 

X  CUBE 

0.936 

0.909 

1.000 

0.362 

* 

Y 

0.322 

0.350 

0.362 

1,000 

. . . . . . . . . I . . 

FIRST,  SECOND,  AND  THIfiO  DEGREE  POLYNOMIALS, 

BsiBtaiai iiasaaccaiisaasgaaiBoaaiiiaioicaiaiaaBiaiioiaaaiiiaiiiiigiiin aaa 

MULTIPLE  R  SOUARE  •  0.1JS* 

MULTIPLE  R  a  0.322 

N.0.F.1  ■  I 
N.D.F.2  »  56 

F  FDR  ANALYSIS  OF  VARIANCE  ON  R  »  6. *93 

BFTa  WEIGHTS 
0.322 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ano  REGRESSION  Factor  LOADINGS,  2ND  COLUMN) 

)  X  0,10*  1,000 

SQUARED  BETA  WEIGHTS 

0.10* 

B  WFIGHTS 
I  .91* 

INTERCEPT  CONSTANT  ■  *.580 

tc8:a33BBx:B:BaaB3B BsSiGBSiaafsaiiiaisaiasssBisaSBiiiBiBiaiBipaiyBigsigsag 

MULTIPLE  R  SOUARE  ■  0 • 1 3 I 

MULTIPLE  R  ■  0.36? 

N.O.F.l  a  2 
N.O.F.?  ■  55 

F  FDR  ANALYSIS  OF  VARIANCE  ON  R  «  *.1*2 

BETA  WEIGHTS 
-0.*17  6.757 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ano  regression  factor  l°aoingsi  2no  column) 

)  X  -0.13*  0.891 

?  SOUAR  0,265  0.960 

SOUaREO  beta  weights 

0.17*  6.573 

B  WEIGHTS 
-2. *75  *.9?2 

INTERCEPT  CONSTANT  ■  *.773 

.  . . . . . . . 

MULTIPLE  R  SOUARE  ■  0 . 13* 

MULTIPLE  R  ■  6.367 

N.O.F.l  ■  3 

N.D.F.2  »  54 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  2*796 

BETA  WEIGHTS 

0,378  -1,251  1,2*6  . 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

jNO  REGRESSION  FACTOR  LOADINGS*  2N0  COLUMN) 

I  X  0,122  0.879 

?  SOU*R  -0 , *38  0.953 

3  X  CUBE  0,*5i  0.907 

SOUAREO  BETA  WEIGHTS 
0,1*3  1,565  1.552 

b  weights 

2.2*5  -8.TT6  8,660 

INTERCEPT  CONSTANT  ■  *,739 


ANOVA  TABLE. FOR  POLYNOMIALS 

. . . 

REDUCTION  oof  TO  LINEAR  FIT.  WITH  1  OF  a  0.10* 

RESIDUAL  S.S.  ■  0.896  OF  ■  56  RESIDUAL  M.S.  «  0.616 

F  for  Linear  riT  ■  6. *93 

laia.i.aaaiiiBi.iaaaaiiaaaaa.iaiaaMiaaiaaaaaaiii.aaaaiaa.i.aaaiaiaaaaiaaa 

reduction  due  to  general  quadratic  fit  with  of  2,  «  o.ui 

REDUCTION  M.S.  ■  0.063 

RESIDUAL  S.S,  ■  0.869  OF  »  55  RESlOUAL  M.S,  a  0.016 

F  FOR  QUADRATIC  FIT  a  **1*2 

REDUCTION  OlIF  TO  QUADRATIC  TERM  ALONE,  WITH  1  OF*  a  0.02? 

F  F/)R  QUADRATIC  TERM  ALONE  a  1,709 


reduction  due  to  general  cubic  fit  with  of  3»  0,13* 

REDUCTION  M.S,  a  0.0*5 

RESIDUAL  S.S.  ■  0*«66  OF  a  5*  RESIDUAL  M.S.  ■  0.016 

F  FOR  OFNERAi.  CUBIC  FIT  ■  2.790 

REOUCT ION  DUF  TO  CUBIC  TERM  ALONE  WITH  l  OF  »  ,  0,00* 

F  FOR  CUBIC  TFRM  ALONE  a  0.222 

fliBiifliiiiiiioiiiiBBiBiiaa>3iiiiiiiiiir  ■■•■■■■■a iiiiBiaiiaiaai 


oni^*:ii-aiB;jo-ji5iaaaflajuBa3  0B'iD4B;i«20»333aa3a3a3ac*<t:s33Hg***!ii«SB3!iot*a3iaa 

POLYNOMIAL  PITTING  FOR  2  VARIAULES-GR£  ANO  TP  SCORe-  58  ORSEuVaT  1  QnS, 


ie  RATING 

THE  PREDICTOR  VAR1ARLE<X)  IS  GRE,  ANO  THE  CRITERION  '/A"!  I  ABLE  <  Y)  IS  Tp  SCORE. 

TEST  MEANS  AND  STaNOAHO  DEVIATIONS 


1  X 

0.886 

0.161 

2  SQUAR 

0  ,  A  1  I 

0.214 

1  X  CUBE 

0.751 

0.261 

4  Y 

5.552 

2.3/1 

CORRELATION 

matrix 

)  X 

I.  000 

0.954 

0.901 

0.387 

2  SOUAR 

0.954 

1.000 

0.989 

0.188 

3  X  CUBE 

0.901 

0.989 

1.000 

0.381 

4  Y 

0.387 

0.388 

0.3«i 

1 .000 

. . .  . . . . sinus . . . . 

FIRST .  SECON0,  AND  THIRD  riEGREE  POLYNOMIALS. 

. . . . . 

MULTIPLE  R  SQUARE  «  0.149 

multiple  R  -a  0.387 
N.O.E.I  »  i 
N.O.E.?  s  5 A 

E  FOP  ANALYSTS  OF  VARIANCE  ON  R  ■  9.838 

8FT A  WEIGHTS 
0.187 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

and  regression  factor  loadings.  2N0  column) 

T  X  0.149  1.000 

squared  beta  weiomts 

0.149 
B  WflOHTS 
5.706 

INTERCEPT  CONSTANT  ■  0.494 

aaaafisaiagaiisaeiiaiaaaaaaagsiaiaaaeBiaaaiaasaaiiaaiaiiialiiaiaaaaaaaaaaa) 

MULTIPLE  R  SQUARE  *  0.154 

MULTIPLE  R  »  0.392 

N.O.F.l  »  2 

N.O.F.2  •  55 

F  FOP  ANALYSIS  OF  VARIANCE  ON  R  •  4.995 

BETA  WEIGHTS 
0.178  6.219 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOADINGS.  2ND  COLUMN) 

T  X  0.069  0.9«6 

2  SOUAr  0.085  0.991 

SQUARED  BETA  WEIGHTS 

0.032  0.048 

B  WEIGHTS 

2.626  2.4?9 

INTERCEPT  CONSTANT  o  1.263 

csaataaasaiaaaasaaaaaataaMsaaaetiaaaaaiaaaaaaaiisaiiiaail.aiiitiaiiaaatia 

MULTIPLE  R  SQUARE  »  0.169 

MULTIPLE  R  ■  0.411 

N.O.F.l  •  3 

N.D.F.2  ■  54 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  3.668 

BETA  WEIGHTS 

1.813  -4.772  3.467 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOADINGS.  2N0  COLUMN) 

1  v  0.701  0.939 

?  SOUAR  -1.853  0.944 

3  X  CUBE  1.322  0.927 

SQUARED  BETA  WEIGHTS 

3.287  22.767  12.023 

B  WFIGHTS 

26.763  -52.768  31,315 

INTERCEPT  CONSTANT  ■  0*953 


ANOVA  TABLE  FOR  polynomials 

■80a3aaaaiii33«a8i8aataaa»83a83aiiS3iiitii«i8aii8iiiiaifliitiiltiia*«laii9 

REDUCTION  DUE  TO  LINEAR  FjT.  WITH  1  OF  »  0.149 

PESIOUAL  S.S.  ■  0.851  OE  ■  56  RESIDUAL  M.s,  m  0.015 

E  FQR  LINEAR  FIT  »  9 ,83*3 

iiaE&a383a>8aa8iaiiia>i»>9iaiaiai3  8ai8iiiiaiaatiia3iaiiiii»iaiaaiiaia8i9 

REDUCTION  OUE  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2i  ■  0.154 

REDUCTION  M.S.  »  0.077 

RESIDUAL  S.S.  ■  0.A46  OE  ■  5S  RESlOUAL  M.S.  ■  0.015 

F  FOR  QUAORATIC  FIT  >  4*.99S 

RFOIIC  T I  ON  OUE  TO  QUADRATIC  TERM  ALONEi  WITH  1  cE»  ■  0.004 

f  for  quaorattc  term  alone  •  o.2ao 

■  ■iBaaiiBitiBiaaaa>ia>aaaa8iaiaiatia3taiaaiatiiiiisaaiaiiBa>itiiaaiCaa8aia  - 

REDUCTION  OIJF  To  GENERAL  CUBIC  FIT  WITH  OF  3i  .  0.169 

REDUCTION  M.S.  ■  0.056  1-1  7 

RESlOUAL  S.S.  ■  n  .831  OF  »  54  RESiDUAL  M.S.  ■  0.015 

F  FoR  GfnEPAi.  cubic  FIT  »  3.668 

REDUCTION  OUE  TO  CURIC  TERM  ALONE  WITH  1  OF  »  , 

F  FOR  CUBIC  TFRM  ALONE  ■  I.0I2 

■  ■saiaBOsBiBaaiiioiaaiioaMaiBiBaioiia'.  saaaiiai 


0.016 


.  . . 

POI.YNOMUL  FITTING  FOR  2  VARIA^LES-WRE  ANO  TP  SCOPE-  58  OBSERVATIONS, 


IC  RATING 


THE 

PREDICTOR 

VARIARLE(X) 

IS  WRE,  ANO 

the  criterion 

VARIABLE (Y)  IS  TP  SCORE, 

TEST 

MEANS  AND 

STANOARC  DEVIATIONS 

1 

X 

0.5*2 

0.190 

2 

SOUAR 

0.329 

0.207 

3 

X  CUBE 

0.216 

0.189 

4 

Y 

5.552 

2.371 

CORRELATION  MATRIX 

1 

X 

1.000 

0.982 

0.942 

0.43* 

2 

SOUAR 

0.982 

1.000 

0.988 

0.382 

3 

X  CUBE  . 

0.942 

0.988 

1.000 

0.3*3 

4 

Y 

0.43* 

0.382 

0.3*3 

1.000 

asaaiBiaiisaasasssiniaBgBiaasBissiaaiaBaissisaiaiaaaBitBaisiiaiaixaiagiBt 

FIRST,  SECOND,  and  ThIRO  nEGREE  POLYNOMIALS. 


icnaaaaBBBcasBBBxsaaaiasaaaBaBflaaaaassaBaaaaBaaaaiaaaiasiiasaiaaiiiiniigi 

MULTIPLE  R  SQUARE  ■  O.Je8 
MULTIPLE  R  ■  0.43* 

N.O.F.l  *  T 

N,  0 , F ,7  a  56 

f  for  analysis  of  Variance  On  R  ■  12.997 

beta  weights 
0,434 

contributions  to  multiple  correlation 

ANO  REGRESSION  FACTOR  LOAOINGS*  2ND  COLUMN) 

T  x  o.ies  l.ooo 

SQUAREO  BETA  WEIGHTS 
0.1 88 
B  WEIGHTS 
5.426 

INTERCEPT  CONSTANT  ■  2,611 

aa>BBa3«BB3aaaesaaaa3aaaa8>Baa3aaaaiaiaaa8aaaaaffaaaaiiaBiaaaaa«aBaaaaaaaflS 

MULTIPLE  R  SQUARE  ■  6.2*1 

MULTIPLE  R  ■  0.491 

N.O.F.l  ■  2 

N.O.F.*  a  55 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  8.7*6 

BETA  WEIGHTS 
1,616  -1.2*4 

CONTRIBUTIONS  to  multiple  correlation 

and  REGRESSION  FacTCR  LOADINGS.  2ND  COLUMN) 

1  X  0,701  0.884 

?  SOUAR  -0,460  0.778 

SQUARED  BETA  weights 
2.610  1,449 

B  WFTGHTS 
20.149  -13,8*9 

INTERCEPT  CONSTANT  «  -0.852 

MULTIPLE  R  SQUARE  ■  6. £92 

MULTIPLE  R  ■  0.5*1 

N.O.F.l  •  3 

n.O.F.2  a  54 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  7.4*1 

BETA  WEIGHTS 

5,460  -9,434  5.616 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  L°AOlNGSa  2ND  COLUMN) 

1  X  2.370  0,803 

2  SOUAR  -3.796  0.706 

3  X  CUBF  1.718  0.633 

SQUAREO  BETA  WEIGHTS 

29.815  9A.6A7  25,158 

B  WEIGHTS 

6ft. 262-113. 9*fl  63.029 
INTERCEPT  CONSTANT  ■  -7.572 


.  ANqVA  table  FOR  POLYNOMIALS 

aaaannaaaaBaaaBaaaaaaaaBaaoaaaaaaaaaaaasaaaaaxaaaasaaaaaaaaaaaaaaaaaaaaaaa 

REDUCTION  OUE  TO  LINEAR  FIT.  WITH  1  OF  ■  0.188 

RESIDUAL  S.S.  •  0.812  OF  •  56  RESlOUAL  M,$,  ■  0.014 

F  FOR  LINEAR  FIT  ■  12.997 

.  . . . 

REDUCTION  our  To  general  GUaORaTIC  fit  with  OF  2a  ■  0.2*1 

REDUCTION  m.S.  ■  0.121 

RESIDUAL  S.S.  a  0.759  OF  a  55  RESIDUAL  M.J.  a  0«0l* 

F  FOR  QUADRATIC  FIT  a  fl;T*6 

REDUCTION  DUE  TO  QUADRATIC  TERM  ALONE.  WITH  1  CP.  ■  0.053 

F  FOR  QUADRATIC  TERM  AlOnE  ■  3.836 


REDUCTION  DUE  TO  GENERAL  CUBIC  FIT  WITH  OF  3.  a  0.292 

REDUCTION  M.S.  ■  0.097 

RESIDUAL  S.S.  a  0.708  OF  ■  5*  RESIDUAL  M.S.  «  0.013 

F  FOR  GFNERAi.  CUBIC  FIT  ■  7.4*1 

REDUCTION  OUF  TO  CURtC  TERM  ALONE  WITH  I  OF  •  ,  0.051 

F  FOR  CIIRIC  TFPM  ALONE  a  3.90B 

. . . 


•  iingBaiiigsiaassiBRHSBisBaBaiaiiiiBBiaiiiBiaaaaMdtBaBSvaviMiaRMBBRBBAivda 

POLYNOMIAL  FITTING  fop  z  VARIA?LES-SHE  AND  TP  SCORE-  130  OBSEPVAT IONS. 

RD  RATING 

THE  PREDICTOR  VaRIABLE(X)  IS  SRE,  ANO  THE  CRITERION  VApfABLE(Y)  IS  TP  SCORE, 


TEST  MEANS  AND  STANOARO  OEVIaTIONS 

1  X  0,3*2  0.358 

2  SOUAR  0,2*5  0,283 

3  X  CUBE  0.182  0.232 

*  Y  2,fl06  1.56* 

correlation  matrix 

1  X  1.000  0.977  0,930  *0 ,169 

2  SQUAR  0.977  1.000  0.98*  -0.110 

.3  X  C1J8E  0.930  0.986  1.000  -0.033 

A  Y  -0,168  -O.llO  -0.053  1.000 

laaieBBaammiiMaiiiaaiSBaisiinssmiifliMiiitiBiiiiiimiiiiiaiiiiiii 

FIRST,  SECOND,  AND  THIRO  DEGREE  POLYNOMIALS. 

.  . . 

MULTIPLE  R  SQUARE  ■  0.028 

MULTIPLE  R  ■  0.168 

N.O.E.l  ■  1 

N.0.E.2  ■  137 

E  E oR  ANALYSIS  OE  VARIANCE  ON  R  ■  3*979 

8FTa  WEIGHTS 
-0.168 

C0N7RI8U7I0NS  70  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS,  2NO  COLUMN) 

T  X  0.028  -1.000 

SQUARED  BETA  WEIGHTS 
0.028 
B  WEIGHTS 
-0.733 

INTERCEPT  CONSTANT  ■  3*057 

■  ■■aS33*3aai«s3Baaiaaiaa«B  sasVaaasaataaaaaaaaaaaaaataaaaaaaaipaaaaaaBamaBaaaaa' 

MULTIPLE  R  SQUARE  ■  0.093 

MULTIPLE  R  a  0.305 
N.O.E.l  ■  2 

N.0.E.2  »  136 

E  FOR  ANALYSIS  OF  VARIANCE  ON  R  •  6.961 

BETA  WEIGHTS 
-1.326  i.Ts! 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  EacTCR  L°*OINGS.  2N0  COLUMN) 

T  X  0,223  -0.551 

?  SOUAR  -0,130  -0.360 

SOUaREO  beta  weights 
1.758  i,*n5 

B  WEIGHTS 
-5.788  6.559 

INTERCEPT  CONSTANT  ■  3*182 

. . at . . 

MULTIPLE  R  SOIIARE  »  0*131 

MULTIPLE  R  •  0.362 

N.O.E.l  »  3 

N.0.E.2  ■  135 

E  EoR  ANALYSIS  OF  VARIANCE  ON  R  »  6.801 

BETA  WEIGHTS 

1,065  -*,*.i6  3.332 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOADINGS,  2N0  COLUMN) 

)  X  -0,179  -0,*«* 

7>  SOUAR  0,*86  -0.302 

3  X  CUBE  -0,176  -0.1*6 

SOUARED  BETA  WEIGHTS 
1,133  19.677  il.102 

8  WEIGHTS 

*.6*7  -2*. 54*  22,*3o 

INTERCEPT  CONSTANT  ■  3*138 


ANqVA  TABLE  FOR  POLYNOMIALS 

laai.iiii.at.aaiaaaaiiiii'iiaaia.aaiiai.aaaaiii.iaaai.aa.aaiaia.iia.ingg. 

REDUCTION  OIIE  TO  LINEAR  FjT,  WITH  1  OF  ■  0.028 

PESIOUAL  S.S.  ■  0,972  OF  ai  137  RESIDUAL  M.J,  a  0.007 

F  FDR  LINEAR  FIT  •  3,979 


REDUCTION  OUF  TO  GENERAL  CUAORATIC  FIT  WITH  OF  2,  •  0.093 

REDUCTION  M.S.  ■  0.0*6 

RESIDUAL  S.S,  ■  0.907  OF  ■  136  RESIOUAL  M.j,  •  0.007 

E  FOR  QUADRATIC  FIT  a  6*961 

REDUCTION  DDF  TO  QUADRATIC  TERM  ALONE,  WITH  1  CF*  «  0.063 

F  FOR  QUADRATIC  TERM  ALONE  ■  9,690 

aaia.Maia.aii.gaiai,a.,,.aiii.(i.a9.ia,iiiaiaiaiiaaaaaaaa*a.aaaai.a,i 

REDUCTION  OUE  to  GENERAL  CUBIC  FIT  WITH  OF  3,  a  0.131 

REDUCTION  M.5,  ■  (1,0** 

RESIOUAL  8.5.  ■  0,869  OF  •  133  RESjOUAL  M,j,  a  0.006 

F  FOR  OFNERaL  CUBIC  FIT  ■  6.B0I 

REDUCTION  OUF  TO  CUBtC  TERM  ALONE  WITH  |  OF  »  ,  0,038 

F  FDR  CUBIC  TERM  ALONE  ■  5,972 

■  ■ai..Miii.9s»a.aa,iii,.ai,i.aiatm*ia.iiaiii>i9ia..aiiaaaaaaaaian 


■  migsaiiaciiaaixaiasiiiaoaiitiiiiiiiiiasiiiaKiaaaiiiiianoaaaiggidagiaa 

POLYNOMIAL  FITTING  FOR  2  V AR  IA8LES-PRE  AND  TP  SCORE-  139  OBSEPVA  I  10n3, 

RD  RATING 

The  PREDICTOR  VaRIARlE(X)  IS  PRE,  AND  THE  CRITERION  V  API  ABLE  (V) .  IS'-  TR  SCORE, 


TEST  MEANS 

ANO  STANDARD 

DEVIATIONS 

l  X 

0.475 

0.473 

?  SOUAR 

0.447 

0.456 

3  X  CUBE 

0.425 

0.444 

4  Y 

2.A06 

1.564 

CORRELATION 

MATRIX 

1  X 

1 .000 

0.994 

0.9Bj 

■6.215 

2  SOUAR 

0.994 

1.000 

0*997 

-0.213 

3  X  CUBE 

0.902 

0*997 

1  *000 

•0.200 

4  Y 

-0.215 

-0*213 

•0.20P 

1,000 

Baa3aaiaB8Bi3et83iaaa8ii!83>aiB:ai383i9a338aB8=993ai38Ba3BiiBi>aasi3iaia8ai 
FIRST,  SEC0NO,  ANO  TWIPO  SfGREE  POLYNOMIALS, 

83a|88aa3lll8S3aBaaiaB3£aS088a3aal3a3IB=BBS88a3SlB8a8SBl8tBS>BI38l8B|Ba3|S 

MULTIPLE  «  SOliARE  ■  0*046 

multiple  R  »  0.215 

N.O.F.l  «  i 
N.O.F.2  ■  137 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  »  6.6)2 

8FTj  WEIGHTS 
-0,215 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  FACTOR  lOaoINGS*  2N0  COLUMN) 

T  X  0.0A6  -1,000 

SOUAREO  BETA  WEIGHTS 
0.046 

b  weights 

-0.710 

INTERCEPT  constant  »  3*143 


MULTIPLE  R  SOliARE  ■  0.0*6 

MULTIPLE  R  «  0,215 

N.O.F.l  ■  2 

N.O.F.2  a  136 

F  FOR  analysts  OF  variance  ON  R  *  3*202 

BETA  WEIGHTS 
-0,204  -0.010 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTCR  LOAOINGS*  2ND  COLUMN) 
i  X  0.044  -1.000 

?  SOUAR  0,002  -0.994 

SOUaREO  BETA  weights 
0.042  0,000 

B  WfIOHTS 
-0.676  -6.044 

intercept  constant  ■  3,143 

BBBBBiiBaaaBBSBsBiaaBiBsBiBaBaeaBSiiiiaaaBBBflaaaaaiBiaaasiiBBliBiaaiaiaaal 

MULTIPLE  R  SOliARE  «  0.093 

MULTIPLE  R  a  0.304 

N.O.F.l  ■  3 

N.O.F.2  ■  135 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  4.592 

BETi  WEIGHTS 

10.549  -25. 961"  15,252 .  . .  . . .  . . 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FAcTCR  LOADINGS*  2N0  COLUMN) 

T  X  -2.263  -0,705 

?  SOUAR  5.527  -0.701 

i  X  CUBE  -3,171  •  -0.6«3 

SOUaREO  BETA  WEIGHTS 
1 1 1 .2B3  670.951  232.630 
fl  WEIGHTS 

34.915  -aA.a«a  53.736 
InTfRCEPT  CONSTANT  a  3*132 


ANnVA  table  for  POLYNOMIALS 

BiS3aB3i8ii8«aaBiiia8aasB*8B93aa88aBB8iRBai8i8aaiBaaasaB«aaBaaBBBaiiBiaaai 

reduction  buf  to  linear  fit,  with  i  of  a  o*046 
RESIOUAL  S.S.  «  0,954  OF  •  137  RESlOUAL  M.S.  a  0.007 

F  FOR  LINEAR  FIT  a  6,612 


REDUCTION  DUF  TO  GENERAL  QUaORATIC  PIT  WITH  OF  2,  a  0.046 

REDUCTION  M.S.  ■  0.023 

RESIDUAL  S.S.  ■  0.9S4  OF  a  136  RESIDUAL  M.S,  a  0.007 

F  FoR  QUADRATIC  FIT  a  3*2P2 

REDUCTION  DUF  TO  CUAORATIC  TERM  ALONE.  WITH  1  OF,  a  0.000 

f  for  quadratic  term  alone  a  o.ooo 


REDUCTION  OUF  To  GENERAL  CUBIC  FIT  WITH  OP  3*  m  0,093 

REDUCTION  M.S.  a  0.o31 

RESIOUAL  S.S.  a  0.907  OP  a  135  RESlOUAL  M.S,  a  0.007 

r  For  GFNERAI.  CUBIC  FIT  a  4.S92 

REDUCTION  OUF  TO  CUBIC  TERM  ALONE  WITH  1  DP  •  ,  0,047 

F  FOR  CUBIC  TERM  ALONE  a  6.926 

m  a  aaiaiBa  a  a  . . . . .  maa  i>aiaaaaaaaia«>aiaa  Baaaaiaa 


■  nnsiaaaaaaaos/ianaoiiaaaaaaaeaaaaBSiaasaaaasaaaBanaaaaaaaxBaaaaaaaaaaaaaBaa 
POLYNOMIAL  r  I  r T f NO  FOR  2  VARIAblES-GRE  ANO  TP  SCORE-  139  OBSERVATIONS, 


THE  PREDICTOR  VaRIARLEiXI  is  ORE.  AND  THE  CRITERION  VARIABLE(Y)  IS  TP  SCDRE, 


RO  RATING 


TEST  MEANS  . 

ANO  STANDARD 

DEVIATIONS 

1  X  . 

0.969 

0.05* 

2  SQUAR 

0.943 

0.091 

3  X  CUBE 

0.919 

0,119 

*  Y 

2.A06 

1.56* 

CORRELATION 

MATRIX 

1  X 

1.000 

0.992 

0.972 

0.021 

2  SQUAR 

0.992 

1.000 

0.99* 

0  •  006 

3  X  CUBE 

0.972 

0.99* 

1.000 

-*o  .no3 

4  Y 

0.621 

0.006 

•0.005 

1.000 

■  3a333sa3B3aa3esaBiaaaa:aiiiosa3i3aB;»3iasosa38SiBBiB8flii»ilis»8>tlmi 

FIRST.  SECOND,  ANO  third  Kegree  polynomials. 

Bs3:e»3iai83::nisB3aia:i3aB>a3a>9aa:aaassBB>3aaaa»ausBaaaaaaaaaaaaaaaaa 

MULTIPLE  R  SOIIARE  ■  O.OoO 

MULTIPLE  R  a  0.021 

N.0.F.1  a  1 

N.D.F.p  a  137 

F  FOR  ANALYSIS  DF  VARIANCE  ON  R  »  0»060 

BETA  WEIGHTS 

0,021 

CONTRIBUTIONS  to  multiple  correlation 

and  REGRESSION  FacTCR  LOADINGS.  2N0  COLUMN) 

T  X  0.000  1.000 

SOUaREO  BETA  WEIGHTS 
0.000 
B  WEIGHTS 
0,603 

INTERCEPT  CONSTANT  «  2.222 

BBasxBBaaaaaBSBBaaaaaaaBaaaBaaBBaaaBBaaaaaaaaaaaBsaaaaaaaaaaaaaaaBaaaaaaaa' 

MULTIPLE  «  SOIIARE  ■  6.013 

MULTIPLE  R  »  6.113 

N.O.F.l  a  j 
N.0.F.2  a  136 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  0.873 

BETA  WEIGHTS 
0.871  -6.R57 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FACTOR  LOAOINGS*  2ND  COLUMN) 
j  X  0,018  0. 1*5 

2  SOU  AR  >0.006  0.057 

SOUaREO  BETA  WEIGHTS 
0.759  0.T35 

8  WfIGHTS 
?5 . 1 *5  -14,018 

INTERCEPT  CONSTANT  ■  -7.602 

aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaacaaaaBaaaaaaaaasaaaaBaaaaaaaaaaaaaeaaaaaaaa 

MULTIPLE  R  SOIIARE  ■  0. 0*7 

MULTIPLE  R  •  0.217 

N.O.F.l  ■  3 

N.0.F.2  •  135 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  2.218 

BETA  WEIGHTS 
39.917  -85. 57*  *6.272 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  FacTCR  LOaoINGSi  2N0  COLUMN) 

X  0.833  0.096 

2  SQUAR  -0.5S0  O.O^O 

3  X  CURE  -0.236  -0.026 

SOUaREO  BETA  WEIGHTS 

593. 40*7322. 95621*1. i3* 

b  weights. 

152.251********  610,24* 

INTERCEPT  CDNSTANI  a  -280.67* 


a  nova  table  for  pOLyncmiaLs 

aaazaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaBaaaaaaaaaaaaaaaaaaaaaaaaaa 

reduction  due  to  linear  Fit,  with  i  of  ■  o.ooo 
RESIDUAL  S.S.  a  1,000  OF  ■  137  RESIOUAL  M.S.  a  0.007 

F  FOR  LINEAR  FIT  «  0.060 

. . a . . 

reduction  oue  to  general  quadratic  fit  with  of  2.  ■  o.oia  1 

REDUCTION  M.S.  a  0,006 

RESIDUAL  S.S.  a  0.987  OF  *  136  RESIDUAL  M.S,  a  O.OOT 

F  FO«  QUADRATIC  FIT  a  0.873 

REDUCTION  OUE  TO  QUADRATIC  TERM  ALONE.  WITH  1  OF.  a  0.012 

F  FOR  QUADRATIC  TEQM  ALONE  ■  1.686 

. . .Baaaaaaa . . 

reduction  due  to  general  ?ubic  fit  with  of  3.  .  0.0*? 

REDUCTION  M.S.  •  0.016 

RESIDUAL  S.S.  ■  0.953  OF  a  133  RESIDUAL  M.S.  a  0.007 

F  for  general  cubic  fit  ■  2.218 

REDUCTION  DUE  to  cubic  TEBM  alone  WITH  1  OF  •  ,  0,03* 

F  FOR  CUBIC  TERM  alone  a  *,858 

iiiaaiiiiaaiiiiaaiaafliaiiaiBBiiaiiMBPaaiiiaiaiiiiiBiaiaiaaiMaaiiaiiaigii 


a«aiaauaa«aa9aaaai>3a>os3aV!fn«aBisaaaa34Bcaaiiaaaa^3iiata(MitJiiBiiai]aiiVa3a 

POLYNOMIAL  FITTING  FOH  2  VARIA^LES-WRE  ano  tp  score-  13«  observations* 

RD  RATING 

The  PREOICTOR  VaRIARlE(X)  IS  WRE,  ANO  THE  CRITERION  VfRIABLE(T)  tS  TP  SCORE, 


TP5t  MEANS  ANO  STANOARC  DEVIATIONS 


1  X 

0.617 

0.183 

?  SOUAR 

0  .  A 14 

0.227 

3  X  CUBE 

0.296 

0.232 

A  Y 

2,806 

1.564 

CORRELATION 

MATRIX 

I  X 

I. 000 

0.983 

0.949 

-O.oSl 

2  SOUAR 

0.983 

1.000 

0.990 

■6.073 

3  X  CUBE 

0,949 

0.990 

1.000 

■  0.085 

4  Y 

-  0  .  0  5 1 

-0.07S 

-0.085 

1 .000 

. . . 

FIRST,  SECOND,  ANO  THIRD  nEOREE  POLYNOMIALS. 

. . . . 

HUUIPU  R  SOIIARE  »  0.0^3 

MULTIPLE  R  a  0.051 

N.O.F.l  a  } 

N.0.F.2  a  137 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  0.362 

BETi  WEIGHTS 
-0.051 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  lOaqINGSi  2N0  COLUMN) 

T  Y  0.003  -1.000 

SOUaREO  beta  WEIGHTS 
0.003 
B  WEIGHTS 
-0.438 

INTERCEPT  CONSTANT  a  3*076 

■ aasa3aaaaa3iss8aai8ii3a388asaaai8iaEiie83i8aaiaai3aiaaS8Hal*8iaaaaia8a«i 

MULTIPLE  R  SOIIARE  ■  0.021 

MULTIPLE  R  ■  fl.US 

N.O.F.l  a  2 

N.0.F.2  a  136 

E  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  1.457 

BETA  WEIGHTS 
0,66<J  -6.713 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOAOlNGSa  2N0  COLUMN) 

1  X  -0,034  -0.3*4 

2  SOUAR  0.0S5  -0.521 

SOUaREO  BETA  '-'EIGHTS 

0.448  6.538 

B  WEIGHTS 

5,715  -5.044 

INTERCEPT  CONSTANT  a  1.368 

iiafaaiaaaaaaaaaaasaaaaaaaiaaaaaaaaflaaaaaaaaaaaaaaaaaaiaaaaaaaaaaaaaaaaaaa 

MULTIPLE  R  SOIIARE  a  0.041 
MULTIPLE  P  ■  0.204 

N.O.F.l  a  3 
N.0.F.2  a  135 

F  FflP  ANALYSIS  OF  VARIANCE  ON  R  •  1*946 

BFTa  WEIGHTS 

3,072  -6,359  3,337 

CONTRIBUTIONS  to  multifle  CORRELATION 

ano  REGRESSION  FacTCR  L°A0INGS*  2ND  COLUMN) 

T  X  -0.158  -0.2*2 

2  SOUAR  0.483  -0.371 

3  X  CUBE  -0.284  -0.418 

SOUAREO  BETA  WEIGHTS 

9,439  46,947  11.134 

R  WEIGHTS 

26.233  -44,0)7  22,482 

INTERCEPT  CONSTANT  ■  -1.814 


ANoVA  TABLE  FOR  POLYNOMIALS 

REDUCTION  OUE  to  LINEAR  Fit,  WITH  1  OF  a  0.003 

RESIDUAL  S.S.  a  0.997  OF  a  137  RESlOUAL  M.S'.  m  0.007 

F  F nR  LINEAR  FIT  a  0.362 

aaaeaaaaaaxaaaaaaaaaaaaaaBvaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa 

REDUCTION  OUF  TO  GENERAL  OUAORATIC  FIT  WITH  of  2.  a  0.021 

REDUCTION  M.S.  a  O.OlO 

RESIDUAL  S.S.  a  0,979  OF  a  136  RESlOUAL  M,$,  «  O.OOT 

F  FnR  QUADRATIC  FIT  a  1.457 

REDUCTION  OUF  TO  CUAORATIC  TFRM  ALONE,  WITH  1  CF*  a  0.018 

f  for  ouaoratic  term  alone  ■  2.540 

aaaaaaaaaaiaaaaaaiiaiaaaaaaaBaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaiiaaaii 

RFOllC  T I  ON  niJE  TO  GENERAL  ?UBIC  FIT  WITH  OF  3,  .  0.041 

REDUCTION  M.S,  a  0,0)4 

RESIDUAL  S.S.  a  0.959  OF  a  135  RESlOUAL  M.S,  a  0.007 

F  FnR  GENERAL  CUBIC  FIT  a  1,946 
REOUCTION  DUE  TO  CUBIC  TERM  ALONE  WITH  l  OF  ■  , 

E  E f)R  CUBIC  TFPm  ALONE  a  2.B83 


0.020 


saasixaBiiasBsa&aas^osMissOsifiBaJasRMSsaaasoaisniiasiiiisaaf  asMasia?«ias3to« 
POLYNOMIAL  PITTING  top  2  VAHIAOlES-SHE  and  TP  SCOPE-  137  OBSEnVAT ions. 


RM  RATING 


THE  PREDICTOR  VaPIARLE(X)  IS  SHE,  ANO  THE  CRITERION  VaRIaBLE(Y)  IS  TP  SCORE,' 


TEST  MEANS 

AND  STANDARD 

DEVIATIONS 

1  X 

0.628 

0.33J 

2  SOUAR 

0.303 

0.346 

3  X  CUBE 

0 ,  *26 

0.356 

A  Y 

*.453 

1.925 

CORRELATION 

MATRIX 

i  X 

1.000 

0.960 

0.907 

0.211 

•  2  SOUAR 

0.O60 

1  *000 

0.980 

0 ,23* 

3  X  CUBE 

0.9  07 

0.988 

1.000 

0.24* 

4  Y 

0.211 

0.234 

0.24* 

1.000 

. . . 

FIRST,  SECOND.  AND  THIRD  OEGREE  POLYNOMIALS. 

saasiasaaaaasttaaaaaaaaiiaaiaecsaaaaaaaaaaasaaaaaaasiaaiiaaaaaaaiigiiagm 

MULTIPLE  R  SOIIARE  ■  0.0** 

MULTIPLE  R  «  0.211 

N.O.F.l  a  T 
N.D.F.p  ■  135 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  6.285 

BFT »  WEIGHTS 

0,211 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOADINGS*  2ND  COLUMN) 

T  x  0,0**  i.ooo 

SOUAREO  BETA  WEIGHTS 
0.04* 

B  WFIGHTS 
1.228 

INTERCEPT  CONSTANT  *  3*681 

aEaaaaasggggagsssaagiiiagiacgaaisaaaiaagaagaaagsaaggggggiaaaatagiagigiigii 

MULTIPLE  R  SQUARE  *  0.057 

MULTIPLE  R  «  0.238 

N.O.F.l  ■  2 

n.O.F.2  ■  1 3* 

f  for  analysis  of  variance  on  r  ■  *.03* 

BETi  WEIGHTS 
-0.16B  6.30* 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOADINGS*  2ND  COLUMN) 

T  X  -0.035  0.8«5 

?  SOUAR  0.092  0.980 

SQUARED  BETA  WEIGHTS 
0.028  6.156 

B  WfIGHTS 
-0.976  2. Ill 

INTERCEPT  CONSTANT  ■  3,968 

aasaiasisisiasaaaasiaiaBgaaagiiaaBassaasasaalaaBlaasaBisBiiaatagaagiatsisi 

MULTIPLE  R  SQUARE  »  0.0*8 

MULTIPLE  R  »  0.260 

N.O.F.l  »  3 

N.O.F.2  >  133 

f  fqr  analysis  of  variance  on  fl  *  3.218 

BETA  WEIGHTS 

0,7*6  -2.231  1.770 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FACTOR  LOADINGS*  2ND  COLUMN) 

T  X  0,157  0.811 

2  SOUAR  -0,521  0.898 

i  X  CUBE  0,431  0.937 

SQUARED  BETA  WEIGHTS 
0.557  4.976  3,i33 

B  WFIGHTS 

4.346  -12.337  9.567 

INTERCEPT  CONSTANT  »  3*857 


ANQVA  TABLE  FOR  POLYNOMIALS 

aaaaaaaaaa . aaa . a . . . aaaaaaa . laaaaaaaaaaa 

REDUCTION  DDF  TO  LINEAR  FIT,  WITH  1  OF  ■  0.04* 

RESIDUAL  S.S.  *  0,956  OF  ■  135  RESIDUAL  M.s.  ■  0.007 

F  FOR  LINFAR  FIT  »  6.285 

. . a* . . . . 

REDUCTION  OltF  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2,  «  0.037 

RFDUCTTON  M.S,  ■  0,028 

RESIDUAL  S.S,  ■  0.9*3  OF  •  13*  RESIDUAL  M.S.  «  0.007  . 

F  FDR  QUADRATIC  FIT  ■  4*03* 

REOUCT ION  OUE  TD  CUADRATIC  TERM  ALONE*  WITH  1  DF*  ■  0*012 

F  for  quadrat *c  term  alone  »  1.7*8 

. . a . .  aaaaaagaaa . aaaaaaaaa . . . 


RFDllCTION  DUF  TO  GENFRAL  cubic  fit  WITH  OF  a*  0,068 

REDUCTION  M.s,  ■  0*023  1-23 

RFSinUAL  S.S.  ■  0.932  OF  »  133  RESIDUAL  M.J,  •  0.007 

F  FnR  GENERAL  CUBIC  FIT  ■  3.218 

RFOUCTION  OUE  TO  CUHTC  TERM  ALONE  WITH  1  OF  ■  ,  0,011 

F  FDR  CUBIC  TFRM  ALONE  ■  1.35* 


laana^aaaM^^aaoau^aaiiaoi^iaascaiaissiflaaaaaMiaussiisaiassasaaasaianil 
POLYNOMIAL  FITTING  Fn«  2  VARlA^S-FMe  AMO  TP  SCOPE-  137  0B3F.PVATI0MS 


RM  RATING 

THE  PREDICTOR  VARIARLEIX)  IS  PRE,  ANO  THE  CRITERION  VARIABLE (Y)  IS  TP  SCORE. 

TEST  MEANS  ANn  STANnARO  DEVIATIONS 


i  x 

0.P00 

0.341 

?  SQUAR 

0.756 

0.3*2 

3  X  CURE 

0.719 

6.348 

A  Y 

4.453 

1.925 

CORRELATION 

MATRIX 

1  X 

1.000 

0.905 

0.953 

0.156 

2  SQUAR 

0.985 

1.000 

0,991 

0.164 

3  X  CUBE 

0.953 

0.991 

1 .000 

0.167 

4  Y 

0.156 

0.164 

0.167 

1.000 

sa3si3naiia8ssis83Sa3s:s3«(i8iaasmas33icaii8sa84i23ii3aiBRaaiasifligai8ii8 

FIRST#  SECOND,  aMO  THIRD  nCGREE  PyLYNOMjALS • 

■ssaaaaaiaaiaaafliasiaaBasiiiaiiaaaMaasaiaaaaaaiaiaBiaasaaaailiaiasiiaiaia 

MULTIPLE  R  SQUARE  *  0.024 

MULTIPLE  R  ■  0,156 

N.O.F.I  ■  j 

N.0.F.2  ■  13S 

F  FOR  analysis  of  Variance  on  R  ■  3.387 

8fTa  weights 

0.156 

contributions  to  multiple  correlation 

and  REGRESSION  FacTCR  LADINGS*  2NO  COLUMN) 

T  X  0.024  1,000 

SOUaREO  BETA  WEIGHTS 
0.024 
B  WFIGHTS 
n.fl«2 

INTERCEPT  CONSTANT  •  3«747 

ca;:333a=a3i::;sa38.3aiafli8ssiB38aas:3aasi;3i3,si:a389s:«i83iisiiasSiO]a3i 

MULTIPLE  R  SQUARE  ■  0.02B 

MULTIPLE  R  ■  0.1A6 

N.O.F.I  ■  2 

N.0.F.2  a  134 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  »  1.902 

BETA  WEIGHTS 
-0.159  0.320 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOADINGS.  2N0  COLUMN) 

T  X  -0,025  0.9*2 

j>  SQUAR  0,052  0.906 

SOUAREO  BETA  ^EIGHTS 
0.025  0 , 1 "2 

B  weights 
-0 ,894  l.nnl 

INTERCEPT  CONSTANT  »  3 . 8 o 7 

. . a . . . . 

MULTIPLE  R  SQUARE  «  0.631 

MULTIPLE  R  »  0.177 

N.O.F.I  a  3 
N.O.F.2  »  133 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  1.428 

BETA  WEIGHTS 

1 .852  -4,346  "'2,710  . . . 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ftNO  REGRESSION  FacTCR  LOADINGS*  2N0  COLUMN) 

1  X  0.290  0.fl»6 

?  SQUAR  *0.712  0.927 

3  X  CUBE  6.453  0.947 

SOUaREO  BETA  WEIGHTS 
3.430  Ifl.BQO  7,343 
B  WEIGHTS 

10.440  -24.45B  15,610 

INTERCEPT  CONSTANT  ■  3,795 


ANqVA  TAHLE  for  POLYNOMIALS 

. . . . . 

REnUCT  I  ON  OtIF  TO  LINEAR  F  j  T  ,  WITH  1  OF  a  0.024 

RESIDUAL  S.S.  ■  0.976  OF  •  135  REsiOUaL  »,S,  ■  0.007 

F  FOR  LINEAR  FIT  ■  3.387 

sasaasaassaaaansaasaasaaaBSaasaBBaaasaaasaasaaaaasisaaaaasBBBaBaaaaBaaaaaa 

REDUCTION  OUF  TO  GEnEPAl  QUADRATIC  FIT  WITH  OF  2,  ■  0.026 

REDUCTION  M.s.  ■  6.01* 

RESIDUAL  S.S.  ■»  0.972  OF  •  134  RESIDUAL  M.s.  •  0.007 

F  FOR  QUADRATIC  FIT  a  1.902 

REDUCTION  DUF  TO  CUAQPITIC  TERM  ALCNE.  WITH  1  nF,  ■  0.003 

F  FnR  QUADRATIC  TERM  ALONE  a  0.*G2 

. . . . . . . . . 

RfllMCriON  DUE  TO  GEnFRAl  CUBIC  FIT  WITH  OF  3,  ,  0,031 

RFOllCT ION  M.S.  «  0.010 

RESIDUAL  S.S.  a  0.96?  OF  ■  133  RESIOUAL  M.S,  a  0.007  1-24 

F  FOR  OFNERAl  CUBIC  FIT  •  1.428 

REOUC T ION  OUF  TO  CUBIC  TERM  ALONE  WITH  1  OF  «  ,  0.004 

F  FDR  CUBIC  TrRM  ALONE  a  0.493 


■  sBuaiaiaasoasssu.ianvBaaaBaasaasuaaaiiaiiaoaBCCiiaasuaaBiiasBaBBBoasaa  as  :■*■■■ 

POLYNOMIAL  FITTING  FOR  2  VAR  I  ABLES-GPE  AND  TP  SCORE-  137  CBSER V A l IONS . 


RM  RATING 


THE  PREDICTOR  VaRIaBlE(X)  IS  GRE,  and  THE  CRITERION  VaRIaBLE(Y)  IS  TP  SCORE, 

TEST  MEANS  ANO  STANDARD  DEVIATIONS 


1  X 

0.997 

0.007 

2  SOUAR 

0  .995 

0.013 

3  X  CUBE 

0.992 

0.019 

*  Y 

*.*53 

1.925 

CORRELATION 

MATRIX 

)  X 

1.000 

1.000 

1.000 

0.0*1 

2  SOUAR 

1.000 

1.000 

1.000 

0  •  0  *  * 

3  X  CUBE 

1.000 

1.000 

1.000 

0.0*6 

*  Y 

0.6*1 

0.0** 

0.0*6 

1.000 

. . . . . 

FIRST,  SECOND,  AND  THlRO  DEGREE  py.L  TNOM I ALS  , 

&3ii:(:Baaiinas:aaBaB4ea>aaB3a:Qiicia3Mie:i:sa:4  3isialsiiiMi>tRfliiiiiiiBis 

MULTIPLE  R  SQUARE  a  0.0*2 
MULTIPLE  R  ■  0 .041 

N.O.F.l  a  i 
N.O.F.2  a  135 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  0»227 

BETA  WEIGHTS 

0,0*1 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FACTOR  L°A0INGSa  2N0  COLUMN) 

T  X  0.002  1,000 

SOUaREO  BETA  WEIGHTS 
0,002 
R  WEIGHTS 
12,033 

INTpRcEPT  CONSTANT  ■  »7.551 

. . a 

MULTIPLE  R  SOHARE  ■  0,1*0 

MULTIPLE  R  ■  0.37* 

N.O.F.l  ■  2 

N.O.E.2  a  1 3* 

E'FOR  ANALYStS  OF  VARIANCE  ON  R  «  10.069 

BETA  WEIGHTS 
-51,053  31.6*5 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOADINGS.  2N0  COLUMN) 
j  X  -2,092  O.llO 

2  SQUAR  2.231  0.117 

SOUaREO  BETA  WEIGHTS 
606.36B2610.6RI 

B  wfights 

•••;«**7A44,570 

INTERCEPT  CONSTANT  a  7356.3** 

. . . 

MULTIPLE  R  SOIIARE  ■  0.139 

MULTIPLE  R  ■  0.372 

N.O.F.l  a  3 
N.O.E.2  a  133 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  »  7.131 

BFTA  WEIGHTS 

-35,0*7  tR.S?8  15.563 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOaoInGS.  2NO  COLUMN) 
j  .X  - 1 , *36  O.llO 

2  SOUAR  0.853  0.117 

3  X  CUBE  0.722  0.125 

SOUaREO  BETA  WEIGHTS 

228,327  381.346  2*2. f93 
B  WFIGHTS 

*•*••*• 2R21.6R 7 1580, 930 
INTERCEPT  CONSTANT  a  5796.98? 


ANOVA  table  FOR  POLYNOMIALS 

. . a, . . 

REDUCTION  OUF  to  LINEAR  fit.  with  1  OF  a  0.002 

RESIDUAL  S.S,  a  0.998  OF  a  135  RESIDUAL  M.J.  a  0.00T 

E  FOR  LINEAR  FIT  a  0.227 


REDUCTION  DUE  TO  GENERAL  QUADRATIC  FIT  WITH  OF  2,  a 
REOtiCT  I  ON  m.s.  »  0.070 

RFSIOUAL  S.S.  a  0.860  OF  a  13*  RESlOUAL  M.J, 

F  FOR  QUADRATIC  FIT  a  10.869 

REDUCTION  OUF  TO  CUADRaTIc  TERM  ALONE.  WITH  1  OF  a  a 
F  FOR  OUAORATIC  TERM  ALONE  a  2l.*76 


0.1*0 


•  0.006 
0.138 


REOIICTiON  OUF  TO  GENERAL  CUBIC  FIT  WITH  OF  3.  a  0.139 

REDUCTION  M.S.  a  0.0*6 

RESlOUAL  S.S.  a  0.861  OF  a  133  RESIDUAL  M.J,  •  0.006  1-25 

F  FoR  GENERAL  CUBIC  FIT  a  7.131 

REDUCTION  OUF  TO  CUHiC  TERM  ALONE  WITH  1  OF  ■  -0,001 

f  for  cubic  tfrm  alone  a  -o.is* 


■  s3^a3iui3iia3t«335sai33i3n3aH3BiBasan5ja'»s3Sasii3>ati8noa!i*3a33»s«*333  33»aa3aMa 
POLYNOMIAL  KITTING  FOR  i  VARIAHLES-wttt  AnO  TP  SCORE-  137  OBSERVATIONS, 


RM  RATING 


The  PREDICTOR  VaRIABLE(X)  IS  WRE,  and  The  CRITERION  VARIAnLE(Y)'  is  TP  SCORE,- 


TFST  MEANS  AMD 

STANDARD 

DEVIATIONS 

1  X 

0.632 

0.232 

2  SOUAR 

0.453 

0.252 

3  X  CURE 

0.342 

0.253 

4  Y 

4.453 

1.925 

CORRELATION  MATRIX 

l  X 

1.000 

0.956 

0.898 

0.366 

2  SOUAR 

0.956 

1.000 

0.983 

0,390 

3  X  CUBE 

0.89e 

0 .985 

1.000 

0.387 

4  Y 

0.366 

0.390 

0.387 

1  .ooo 

aiastaiaaaaaaaa 

sssiasHta 

sBSasdsasaaassass 

3s::3:33saia 

aasaaaasaaaaBiaaisasB 

FIRST,  SECOND. 

ANO  THIRD 

nFGREE  polynomials , 

aa.aaaaaaaaasaa 

asssBssas 

sassaaassasesasss 

SX8333333aillB3Bl3SBaiaa3aaa83B38 

MULTIPLE  R  SQUARE  ■  0 

.134 

MULTIPLE  R  a 

0.366 

N.O.F.l  a  i 

N.D.F.2  a 

135 

F  For  ANALYSIS  OF  variance  ON  R  ■  20.045 

BFTa  WEIGHTS 
0,3*6 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOAOlNGS.  2N0  COLUMN) 

T  X  0.134  1.000 

SoUaREO  BETA  WEIGHTS 
0.134 
8  WFIGHTS 
3.037 

INTERCEPT  constant  a  2.533  • 

3:3:s::9:3:i:::;:3a::::::e93s>«::.i.s33::i3:i3:3ii3iaa:igii3at3iiC9>siaia3  • 

MULTIPLE  R  SOUARE  »  0.1&3 

MULTIPLE  R  a  0.391 

N.O.F.l  a  2 
N.0.F.2  a  134 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  12.103 

BF.Ta  WEIGHTS 
-0,089  0.475 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  FacTCR  LOaoINGS.  2NO  COLUMN) 

1  X  -0,033  0.935 

?  SOUAR  0.186  0.998 

SQUARED  RETA  WEIGHTS 
0.008  0,226 
B  WFIGHTS 
-0,739  3,670 

INTERCEPT  CONSTANT  a  3*276 

saisaEsasBaaasaasaaasarsaasisBBBSiiasaicsaaaianaaiiiiisaaiiaiiaaiaBiaaaaaa 

MULTIPLE  R  SOUARE  a  0.154 

MULTIPLE  R  ■  0.392 

N.O.F.l  *  3 

N.0.F.2  a  133 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  •  8.042 

BETA  WEIGHTS 
-0,260  0.959  -0.324 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOAOINGS.  2N0  COLUMN! 

|  X  -O.OsS  0.933 

2  SOUAR  0,374  0.9V6 

?  X  CUBE  -0.126  0.987 

SOUaREO  beta  WEIGHTS 
0.068  0,919  0.105 

8  WEIGHTS 

-2.159  7.320  -2.472 

INTERCEPT  CONSTANT  ■  3*347 


ANoVA  TABLE  POR  POLYNOMIALS 

aBa-iaaaaiaiaaizasaiaaBasSaaaasaaaiasaassaasasaiaaaasiflasaaiaiaaiiiiisaaaa 
REDUCTION  DUE  TO  LINEAR  FIT,  WITH  1  OF  =  0.134 

RESIDUAL  S.S,  ■  0,866  OF  ■  13S  RESIOUAL  M.s,  a  0,006 

F  FOR  LINEAR  FIT  a  2(1,845 

t,i,i>aa33i,aia»iai3i,333.iMii3Bi3339i:3ig.iiBi,a3mM,iu»a,3aiai„„ 

REDUCTTON  OlIF  TO  GEnERaL  OUAORATlC  FIT  with  OF  2,  a  0.133 

I  REDUCTION  M.s.  »  0.077 

RESIDUAL  S.S.  a  o .8*7  OF  a  134  RESIDUAL  M,J,  a  O.O06 

F  FOR  QUADRATIC  FIT  ■  12.103 

REOUCTION  OUF  TO  QUADRATIC  TERM  ALONE,  WITH  1  CE«  »  0.019 

F  FDR  QUADRATIC  TERM  ALONE  a  3.046 

aaaaaa aaaaaaaaa as aaaaa a aaa*aasaaaaa a saaBiaaiBBBaiaaBMiiaaaaiaaaaaaiaaiaii 

reduction  due  TO  GENERAL  cubic  FIT  WITH  OF  3,  :a  0.134 

REDUCTION  M.s.  ■  0.051 

RESIDUAL  S.S.  ■  0.8*6  OF  a  133  RESIOUAL  M.S,  a  0.006  I-Z6 

F  FOR  GFNFRAL  CUBIC  FIT  a  0.042 

REDUCTION  OUF  TO  CUBIC  TE«M  ALONE  WITH  1  OF  ■  ,  0,001 

F  FDR  CUBIC  TERM  ALONE  a  0.086 

aaiaiisiiiaidaiaBBiaBiiBaBaaaaiaaaiaaaaaaBaaaaaaaiaaaaiiaiiiaiiaaaaiaaaaaa 


saanB0*na8aR9  98dQaSBcSasa>33gaaiia30a93»'ja9'j4:aa'j3:ia9«ri3-jBafla3aaB]i.iK«fla3««3a 
POLYNOMIAL  FITTING  FOR  2  VAR  IAULLS-SRE  ANO  TP  SCOPE.  152  OBSERVATIONS, 


ST  RATING 

TWE  PREDICTOR  VAHIARlE(X)  IS.SRE,  ANO  THE  .CR ! TER  ION  VARtABLElY)'  IS  TP  SCORE, 

TFST  MEANS  AND  STANrtARC  deviations 


1  X 

0,280  0.283 

2  SOUAR 

0 . j  58  0 • 2^0 

3  X  CUBE 

O.llo  0.234 

4  Y 

5.7B3  2.425 

CORRELATION  MATRIX 

1  X 

1.000  0.938 

0.838 

0.199 

?  SOUAR 

0.938  1.000 

0.9flq 

0.246 

3  X  CUBE 

0 .858  0.980 

1*000 

0.259 

4  Y 

0.199  0.246 

0.259 

1.000 

asaaasssssasasassssaaasa 

ataassaaaaaaia 

FIRST,  SECONn, 

ano  third  degree  polynomials. 

essaa:s98>ias3 

sssiasaacaaaaaasasasasaisasuaagaaasaaaiaagaa: 

MULTIPLE  R  SQUARE  •  0.040 

MULTIPLE  R  a 

0.199 

N.D.F.l  a  ) 

N.D.F.2  a 

150 

F  FOR  ANALYSIS 

OF  VARIANCE  ON  R  ■ 

6.217 

BFTa  weights 

0.199 


contributions  to  multiple  correlation 

aNO  REGRESSION  FacTCR  LOADINGS*  2ND  COLUMN) 

i  x  0.0*0  l.ooo 

SpUarED  beta  weights 
0.040 
R  WcIGHTS 
1.711 

INTERCEPT  constant  a  5*3o4 

asB3s::83ss8sL‘2::8B8S3ia3sa>3:8s:sss3ss>ss9s:aaE>a3gaaassass3>aa9i3aiiS38sa 
MULTIPLE  R  SQUARE  ■  0.0*9 

MULTIPLE  «  «  0.262 

N.D.F.l  a  ? 

N.D.F.2  a  149 

F  FOR  ANALYSIS  OF  VARIANCE  On  R  »  5.483 

BETA  WEIGHTS 
-0,258  0 . 4  RB 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  FACTCR  LOADINGS*  2N0  COLUMN) 

1  X  -0.051  0.762 

2  SOUAR  0,120  0.940 

SOUaREO  BETA  WEIGHTS 

0.067  6.238 

b  weights 

-2.213  4.7?4 

INTERCEPT  CONSTANT  «  5.657 

icasssssaiaasasaaBaaaasaBsaaaisasaasaaaaasasBaasaaaaiaaaaoiaaJaaaasiaiaasi 

MULTIPLE  R  SOHARE  ■  6.069 

MULTIPLE  R  «*  6.263 

N.D.F.l  a  3 

N.0.F.2  a  148 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  a  3*656 

BETA  weights 
-0.142  6.153  0.231'  ' 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 
.  ANO  REGRESSION  FACTCR  LOADINGS*  2N0  COLUMN) 

1  X  -0,023  0.7*9 

2  SOUAR  0.038  0.936 

3  X  CUBE  0,060  0.965 

SOUaREO  BETA  weights 

0.020  0.023  0.653 

B  WEIGHTS 

-1.218  1.403  2,39fl 

INTERCEPT  CONSTANT  a  3,627 


ANOVA  TABLE  FOR  POLYNOMIALS 

aaiiamaixiisiaDaiaiaiaiaiia.iiiisaaiiuaiiaKaioiiiaaaaaaaaaaauiiiait 

PEnUCT ION  0 1  IF  TO  LINEAR  FIT,  WITH  1  DF  a  0.040 

RESIDUAL  S.S.  a  0.960  DF  a  1 50  RESIDUAL  M.S.  ■  0.006 

F  FDR  LINEAR  FIT  ■  6.217 

isisaaaiasiiaaaaaaaaiaiaaaaaaaaaaaiaisaaiaaaiaasiaaaaiiiaiaaaiaaiiMaiasat 

REDUCTION  DUF  TO  GENERAL  QUADRAT  I C  FIT  WITH  DF  2,  a  0.069 

RFDIICTION  M.S.  a  0.034 

RFSIDUAL  S.S.  a  0.931  DF  ■  149  RESIDUAL  M.S,  B  0.006 

F  FOR  QUADRATIC  FIT  a  5«483 

REDUCTION  DUF  TO  QUADRATIC  TERM  ALONE.  WITH  1  CF*  a  0,029 

F  FoR  QUADRATIC  TERM  ALONE  a  4,600 

aaaaaaa . . . . . taaaaaa 

REDUCTION  DUE  TO  GENERAL  CUBIC  FIT  WITH  OF  3,  ,  0.069 

REDUCTION  M.S.  a  0.023 

RESIOU4L  S.S.  a  0.931  OF  a  148  RESIDUAL  M.S.  M  0.006 

F  FDR  OENERaL  CUBIC  FIT  a  3.656 

RFDIICTION  DUF  TO  CUBIC  TERM  ALONE  WITH  1  OF  ■  ,  0,000 

F  FnP  CUBIC  TFRM  ALONE  a  0,071 


iaoani]3as>3it:t3cx3a>83iaaiin3fas;iiinr<'j-:u3aii«:3aasiii23  2iass.iti3  3t!43»al||1l3i4g«la 

POLYNOMIAL  fitting  Fort  2  VArtlABLfcS-PRt  AMO  TP  SCORE.  15?  OBSERVATIONS. 


ST  RATING 


the  preoictor  variablEix)  Is  pre,  AMO  The  criterion  variables)  is  TP  scope. 

TFST  means  ANn  STANOaRC  OEVIaTIOnS 


1  X 

0.5*9 

0.390 

?  SOUAR 

0,452 

0.363 

3  X  CUBE 

0.385 

0.347 

A  Y 

5.783 

2.425 

CORRELATION 

MATRIX 

i  x 

1.600 

0.972 

0.923 

0.058 

2  SOUAR 

0.972 

1.000 

0.987 

0.055 

3  X  CUBE 

0.923 

0.987 

1.000 

0,063 

*  Y 

0.050 

0  •  055 

0.065 

1.000 

ssssasssaiaQsasasiScssiss&ssaBrssiiasaaasaesassaaagsssisaxaaasstsisaasssa 
FIRST.  SECOND,  AMO  THlPO  DEGREE  POLYNOMIALS. 

es3sc::i:a3B::::::ac8 aassBlasascaiisssaeaassssaasiaiaaaBcaaBaBasiaaaiassaa 

MULTIPLE  R  SOiiARE  »  0.0*3 

MULTIPLE  rt  «  0.05R 

N.D.F.l  a  j 

N.O.F.2  a  ISO 

F  FOP  ANALYSIS. OF  VARIANCE  ON  R  0  0.309 

BETA  WEIGHTS 
0,050 

CONTRIBUTIONS  TO  MULTIPLE  correlation 

»NO  REGRESSION  FacTCR  L0aoINGS»  2NO  COLUMN) 

T  X  0,003  1.000 

SDUAREO  BETA  weights 

0.003 
8  VftGMTS 
0.36? 

INTERCEPT  CONSTANT  ■  5;58* 

sssssssaassaseaaaaaaaaassaaaaasaaaaasaaasassaassaaaaaaaasaasaagiaasaaaaaasa 
MULTIPLE  R  SOUAPE  •  O.Oo3 
MULTIPLE  R  =  0.058 

N.D.F.l  a  ? 

N.O.F.2  a  1*9 

F  FOR  ANALVStS  OF  VARIANCE  ON  R  •  0.255 

BETA  WEIGHTS 
0,083  «0.6?5 

CONTRIBUTIONS  TO  MULT t PLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOADINGS!  2NO  COLUMN) 

[  X  0.005  0.995 

?  SOUAR  -0,001  0.9*3 

SOUaREO  BETA  '-EIGHTS 
0.007  6.001 

B  WEIGHTS 

0,516  -6.176 

INTERCEPT  CONSTANT  a  5*577 

3ai:5se38asBs33C8«aisai3aB|B8i383aiisa3isiigasiii3aati3i3aa83i83fg8iaaiaaa 

MULTIPLE  R  SOUARE  a  0.1ft2 
MULTIPLE  R  ■  0*320 

N.D.F.l  ■  3 

N.O.F.2  a  1*8 

F  FOR  ANALYStS  OF  VARIANCE  ON  R  a  5.63* 

BFTA  WEIGHTS 

*.86*  -il.756  7. 177 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FACTCR  LQaoINGSi  2ND  COLUMN) 

T  X  0,203  0.1«2 

?  SOUAR  -0,648  0. 1 “2 

?  X  CUBE  0,468  0.204 

SOUaREO  BETA  WEIGHTS 
P3.659  138. 2o8  51.513 

B  WEIGHTS 

30.272  -78.604  30 . i 61 

iNTfRCEPT  CONSTANT  a  5.410 


ANOVA  TARLF  FOR  POLYNOMIALS 

.  . . . . . 

REDUCTION  01  IF  TO  LINEAR  F'iT,  WITH  1  OF  a  0.003 

RESIDUAL  S.S.  •  0.997  OF  a  ISO  RESIOUAL  N.S,  ■  0.007 

F  FOR  LINEAR  FIT  a  0.509 

aaaaaasaaasaa  aEaaaiaasaaasaaaaiaiaMasiaaBaaaaaaOMaBaaaiiaaaBaiBaaaiaaiaaa 

REDUCTION  OtIF  TO  GENERAL  QUAORATIC  FIT  WITH  OF  2»  a  0.003 

REDUCTION  M.S.  ■  0.00? 

PESlOUAL  S.S,  ■  0.997  OF  a  1*9  RESIOUAL  M.S.  a  0.007 

F  FOR  OUAORA T I C  FIT  a  0.255 

RFOUCTION  OUF  TO  CUAOrtATlC  TERM  AlCNE,  WITH  1  CF*  ■  0.000 

F  FOR  QUADRATIC  TERM  ALONE  a  0.005 

iiaigig»ii>.giggi*»>igi|«ig»i",*****gg*ggg*iaaaaMaaagiiaiiaaiaiiagu 

RFOUCTION  OUF  TO  GENERAL  CURIC  FIT  WITH  OF  3a  a  .0,102 

RFOUCTION  M.S.  a  0.03* 

RESIOUAL  S.S.  a  0.898  OF  a  1*8  RESIOUAL  M.S.  a  0a006  I“28 

F  FpR  GFnEPAL  CURIC  FIT  ■  5.63* 

RFOUCTION  OUF  TO  CUBIC  TERM  ALONE  WITH  1  OF  ■  0a099 

F  FOR  CUBIC  TFRM  ALONE  a  16,339 


iusnonndadjaj33a«iaia3^a3.i««33«uaj3r4iaiJ3na3uaa*33iua'J3Jxijaiiflii|iaMMia>l 

POLYNOMIAL  FITTING  FOH  2  VARIA8LE5-0RE  ANO  TP  SCORE-  152  OBSER VA T IOnS, 


ST  RATING 


the  preoictop  variable (X)  is  gre.  and  the  criterion  variableiy)  is  tp  score. 


TEST 

MEANS 

ANn  STANOARC 

DEVIATIONS 

1 

X 

0.A97 

0.187 

? 

SOUAR 

O.R4o 

0.203 

3 

X  CUBE 

0.790 

0.220 

* 

Y 

5.783 

2.425 

CORRELATION 

MATRIX 

1 

X 

1.000 

0.969 

0.914 

0.099 

2 

SOUAR 

0.969 

1.000 

0.985 

0.183 

3 

X  CUBE 

0.914 

0.985 

1.000 

0  .2*3 

A 

Y 

0.099 

0.183 

0.243 

1  .000 

.  . . . . is . la . lung . 

Fimr,  SECOND,  ANO  THIRD  nEOHEE  POLYNOMIALS. 

csasaasasasiaassaasasBssoosaaaesssiassassisaassaaaasBiaaaiiliasiaasOaiaisl 

MULTIPLE  R  SQUARE  «  0  •  Of  0 

MULTIPLE  R  ■_  0.099 

N.O.F.I  »  T 

N.O.F.2  a  l5o 

F  FnR  ANALYSIS  OF  VARIANCE  ON  R  a  1.490 

BET*  WEIGHTS 
0.099 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

A  NO  REGRESSION  FacTCR  LOaoInGS*  2ND  COLUMN) 

?  X  0.010  I. 000 

SCUaREO  BETA  weights 
0.010 
e  WFIGHTS 
I  .285 

INTFRCEPT  CONSTANT  »  4.630 

■saassasaaaiassaaiaascaasassaaiiiaisasaiasa asaaisislBaiaaiailiaiaaisaasia 


MULTIPLE  R  SQUARE  •  0.L34 

MULTIPLE  R  a  0.366 

N.O.F.I  a  j 
N.O.F.2  a  1*9 

F  FOR  ANALYSIS  OF  Variance  On  R  ■  11.550 

BETA  WEIGHTS 
-1,294  1.437 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

«no  regression  factor  lCaoings*  2N0  column) 

i  X  -0.128  0.271 

P  SOUAR  0.263  0.4$9 

SOUaREO  BETA  WEIGHTS 
1.674  2,064 

B  WFIGHTS 
-16.765  17.133 

Intercept  constant  •  6.437 

■  is:(i93i3i3ii3>3»aa39a3S<aa:3S>a»ES3a9ii3iiai  aaaiiaag.aMaiiaasailal.aaa 

MULTIPLE  R  SQUARE  ■  0.178 

MULTIPLE  R  ■  0.422 

N.O.F.I  a  3 
N.O.F.2  a  148 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  *  I0a692 

BETA  WEIGHTS  ... 

1,686  -5.777  4,?92 

CONTRIBUTIONS  TO  MULTIPLE  CORRELAIION 

aNO  REGRESSION  FACTOR  LOaoINGSi  2ND  COLUMN) 

1  X  0.167  0 .235 

?  SOUAR  -1.056  0.433 

3  X  CURE  1,067  0,575 

SoUaREO  BETA  weights 

2.843  33.374  I9,?88 

S  WFIGHTS 

21.849  -6B.RA6  48,3Si 

TNTFRCEPT  CONSTANT  a  5.825 


anoVA  table  for  polynomials 

aaa.aaaaaaaaaaisaiaijaaiiaiaaaaaaaaaaaaaaassaaaaiaaaaiaaaaiaaMaaaaan.aaa 

REOUCTION  OUF  TO  LINEAR  F I T,  WITH  1  OF  a  0.010 

RESIOUAL  S.S.  a  0,990  OF  •  150  RESIOUAL  M.S.  »  0.007 

F  FOR  LINEAR  FIT  a  I.A90 

aaaiiaaaaaiaiiaaiaaiaaaaaaia.aaaaaaai.Mi.i.gi.iaaaiaaiaaaaaaaaiaaaiaaaa.a 

RFnUCTION  OUF  TO  GENERAL  QUaORATIC  FIT  WITH  OF  2.  a  0.134 

REDUCTION  M.S.  a  0.067 

RESIDUAL  S.S.  a  0.866  OF  a  149  RESIOUAL  M.S.  ■  0»006 

F  FnR  OUAORATTC  FIT  ■  11.550 

REOUCTION  OUF  TO  QUADRATIC  TERM  ALCNE a  WITH  1  CFa  a  0.12* 

F  FOR  QUADRATIC  TERM  ALONE  a  21.408 

■ai.aiaaaaaaaaaaaaaisaaaiaaaaoaaaaaaaaaa.aaaaaiai.iaiii.iaaaaaaaaiiaaaaaaa 

REOUCTION  DUE  TO  GENERAL  CUBIC  FIT  WITH  OF  3»  -a  0.178 

REOUCTION  M.S.  a  0.059 

RESIOUAL  S.S.  a  0.B22  OF  a  1*8  RESIDUAL  M.S.  a  0.006 


F  FOR  GENERAL  CUBIC  FIT  a  10.692 
REOUCTION  OUF  TO  CUBIC  TERM  ALONE  WITH  l  OF  » 
F  FOR  CUBIC  TFRM  ALONE  a  7.9o4 


0,04* 


POLYNOMIAL  FITTING  FOR  2  VARUOLtS-WRE  ANO  TP  SCOPE*  152  CBSErVa IJOnS. 


ST  RATING 

the  preoictor  variahleixj  is  hre,  and  the  criterion  variables  is  tp  score. 


TEST  MEANS  AND  STANDARD  DEVIATIONS 

1  X  0,603  0.207 

2  SQUAR  0 .406  0*237 

3  X  CUBE  0,?92  0.236 

A  V  5.783  2.425 

CORRELATION  MATRIX 

1  X  1.000  0.973  0.92i  0.23* 

2  SQUAR  0.973  I. 000  0.985  0.2*3 

3  X  CUBE  0,921  0.983  1,000  0.263 

4  V  0,234  0.2*5  0.263  1.000 

aaasaasBsaaissasiaaaiiasssaasasaealKaisaassasaBaisaiisaiiaaaiiaauaaMaaa 
FTRST*  SECOND*  AN0  THIRD  DEGREE  POLYNOMIALS, 

ascsassaaaaaaassaBaasaasaBaasEcaaaiaaasisiaiflaaasaaMaaaiaaaMaaaaaaaaaaai 

MULTIPLE  R  SQUARE  »  0.055 

MULTIPLE  R  a  0.234 

N.n.F.l  a  l 

N.P.F.2  a  1 5  0 

F  FDR  ANALYSIS  OF  VARIANCE  ON  R  ■  8.707 

8FTi  WEIGHTS 
0.234 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  FACTOR  LOADINGS.  2ND  COLUMN! 

T  X  0,055  1.000 

SQUARED  BETA  WEIGHTS 
0.055 
B  WEIGHTS 
2.746 

INTERCEPT  CONSTANT  a  4. 120 

isssaaiia asaaassaaaaaaaseaaaaaaiaaaaaaaaaasaaaaaiiaaiaasaaaaiaaaaaaaaasaaa 

MULTIPLE  R  SQUARE  ■  0.080 

MULTIPLE  R  ■  0.283 

N.O.F.l  a  2 

N.O.F.2  a  149 

f  for  analysis  of  variance  on  r  •  6,467 

9FTa  WEIGHTS 
-0,426  0.679 

CONTRIBUTIONS  TO  multiple  correlation 

ano  regression  factor  loadings.  2nd  column! 

i  X  -0.100  0.829 

?  SOUAR  0.180  0,936 

SQUARED  beta  weights 

0,182  6,461 

b  weights 

-4.999  6.917 

INTERCEPT  CONSTANT  a  5*982 

aaaaaaaaaaaaaaaaaaaaaaasaaiiaaasaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa 

MULTIPLE  R  SQUARE  ■  0.123 

MULTIPLE  R  ■  0.351 

N.O.F.l  a  3 
N.O.F.2  a  148 

F  FDR  ANALYSIS  OF  VARIANCE  ON  R  ■  6.925 

BETA  WEIGHTS 
-2.679  6.115  -3,314 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ano  regression  factor  loadings.  2no  column! 

1  X  -0.62s  0.668 

2  SOUAR  1.624  0.754 

1  X  CUBE  -0.873  0.731 

SQUARED  BETA  weights 
7.179  37,644  10,980 

8  WEtGHTS 

-31.415  62,653  -34.560  ' 

INTERCEPT  CONSTANT  ■  9,241 


ANOVA  TABLE  FOR  POLYNOMIALS 

• . . . . . . . . . . 

REDUCTION  DUE  TO  LINEAR  FlT,  WITH  1  DF  a  0.055 

RESIDUAL  S.S.  a  0.945  OF  ■  150  RESIDUAL  M.j,  a  0.006 

F  FDR  LINEAR  FIT  a  P.707 

aaaaaaaaa  a  aaaaaaaaa  aaaaaaasaaaaaaaa  aaaaaaaa  aaaa  aaa  aaaaaaaaaaa.aaaaaaaaaaaa 

reduction  due  to  general  Quadratic  fit  with  df  2.  a  o.oflo 

REDUCTION  M.s.  a  0.046 

oEsIOUAL  S.S.  a  0.920  OF  a  149  RESIDUAL  M,S,  a  0.006 

F  FDR  OlJAORATtC  FIT  a  6.467 

REDUCTION  OUF  TD  CUAdRaTIC  TERM  ALONE.  WITH  1  cF*  ■  0.025 

F  FDR  QUADRATIC  TE»m  ALONE  a  4,050 


REDUCTION  OUF  TO  GENERAL  CUBIC  FIT  WITH  DF  3.  i  0.123 

REDUCTION  M.S,  a  0.041 

RESIDUAL  S.S.  a  0.877  DF  a  148  RESlOUAL  M.j.  a  0.006 

F  FOR  GENERAL  CUBIC  FIT  a  6,925 

reduction  nur  to  cubic  term  alone  with  i  of  •  ,  0.643 

F  FOR  CUBIC  TFRM  alone  a  7.296 


1-30 


■  aissisig^sui  ngaanintiiuiaig  inaiiijaiisiiiisian  jar  .aaaaaaaavaaaaaoaaaa 
POLYNOMIAL  PITTING  P0«  2  VABIAOLES-SRE  AND  TP  SCORE-  39  OBSERVATIONS* 


TM  RATING 


TME  PREDICTOR  VARIARi.EtX)  IS  SRE.  AND  THE  CRITERION  VamjABLEIY)  IS  TP  SCORE, 


tfst 

MEANS 

AND  STANOARC 

DEVIATIONS 

1 

X 

0.173 

0.194 

? 

SOUAR 

0.061 

0.139 

3 

X  CUBE 

0.035 

0.109 

4 

Y 

S.?8Z 

1.986 

CORRELATION 

MATRIX 

1 

X 

1.000 

0  o90S 

0.79i 

0.198 

2 

SOUAR 

0.Q05 

1.000 

0.972 

0.032 

3 

X  CUBE 

0.791 

0.972 

1  .000 

-0.057 

4 

Y 

0.?9P 

0.052 

-0 .057 

)  .000 

ian  =  9iaaai:os3isia<i3sa2isBiaa3saiiaB3:aasiiiiaai>3ia3iaaaiiii8iiioiagiia33i« 

FIRST  t  SFCONOt  ANO  THI&0  OEGREE  POLYNOMIALS* 

asasaasaiaaiaaBSBasaiaaaaiaaaasaaaiaaaiaaaaaasaaaasaiaiaaiaaaaaaiaaaaaaaaa 

MULTIPLE  R  SOUARE  a  0.039 
MULTIPLE  R  ■  0.19R 

N.D.F.i  a  j 
N.D.P.2  a  37 

F  FOR  ANALYSTS  OF  VARIANCE  ON  R  a  1*303 

BETA  weights 
0,198 

CONTRIBUTIONS  TO  MULTIPLE  correlation 

and  REGRESSION  FacTCR  LOaoINGS.  2ND  COLUMN) 

T  X  0.039  1.000 

SQUARED  beta  weights 

0.039 
B  WEIGHTS 
2.024 

INTERCEPT  CONSTANT  a  4.932 

aaasesiasiasassaaaitaiaaaiiaaasaaaiiaiacaflasaaaaasa  sasaaaMMMaasaaaiaaal 

MULTIPLE  R  SOUARE  •  0.129 

MULTIPLE  R  ■  0.359 

N.O.F.l  a  j 
N.0.F.2  a  36 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  2*656 

BFTa  WEIGHTS 
0,835  -6.704 

CONTRIBUTIONS  to  multiple  correlation 

ANO  REGRESSION  FacTCR  LOaoINGSi  2ND  COLUMN) 

)  X  0,165  0.5*1 

2  $OU«R  -0,036  0.144 

SOUaREO  BETA  WEIGHTS 
0.698  6.496 

B  WEIGHTS 

B.55B  -10.348 

INTERCEPT  CONSTANT  a  4.490 

aaaasaaaaaaassasaaaaaaaaaaaaaaaaaBaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa 

MULTIPLE  R  SQUARE  *  0.?17 

MULTIPLE  R  •  0.466 

N.O.F.l  a  3 
N.O.F.2  a  35 

F  FOP  ANALYSIS  OF  VARIANCE  ON  R  O  3.230 

BETA  WEIGHTS 
-0,463  3.047  -2.651 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FACTCR  LOADINGS.  2NO  COLUMN) 

)  X  -0.092  0.*24 

2  SOUAR  0,158  0. Ill 

3  X  CU8F  0,151  -0.122 

SOUaREO  BETA  WEIGHTS 

0.215  9.285  7,628 

B  WEIGHTS 

•4,749  44,764  -48.424 

INTERCEPT  CONSTANT  a  4*802 


ANoVA  TABLE  FOR  POLYNOMIALS 

aaraaaiaaaaisasaaaaascaaaHaaaaaaaiaaiasaaaaaaaaiasaaaiaiasaiwaaaiaaaaaaaa 

REDUCTION  DUE  TO  LINEAR  E)T,  WITH  1  OF  a  0.039 

“ESIOUAL  S.S.  ■  0.961  OF  ■  37  RESIDUAL  M,$,  ■  0.026 

F  FOR  LINEAR  FIT  «  1,503 

■  i9Biiaiiiuiia3i.iiai.aii>3i.giiiiiiiiiiiii.i9ii.iaaa,iaia»ila.ii3iaiiai 

reduction  due  to  OEnERAL  QUADRATIC  FIT  WITH  OF  2«  •  0.129 

REDUCTION  M.S,  a  0.064 

RES  I OUAL  S.S.  a  0,871  or  ■  36  RESIDUAL  M.S,  a  0.024 

F  FOR  QUADRATIC  FIT  a  2*656 

REDUCTION  OUF  TO  QUADRATIC  TERM  ALCNEa  WITH  1  r.F*  •  0.090 

F  FOR  QUADRATIC  TERM  ALONE  «  3,700 

aaai..aaiia..isiaaaaiagi.aaa.i.,>aaagaiiaiaatagaaiaaaaii.aa.aM.aaiaif,.aa 

REDUCTION  OUE  TO  GENERAL  CUBIC  FIT  WITH  DP  3»  a  0,217 

RFOllCT ION  M.S,  a  0.072 

RESIDUAL  S.s,  a  0.783  OF  a  35  RESIDUAL  M.S,  a  0.022  1-31 

F  FoR  OFNERAj.  CUBIC  FIT  a  3.230 

REDUCTION  OUE  TO  CURIC  TERM  ALONE  WITH  1  OF  «  0,686 

f  for  curic  term  alone  •  3.944 


iDSaRiioiaiiaaaiitjistiisaiBoasaaaiaiQaassjaiiiaiiBaasiiugaciaaaoaiiiiasaiisii 

POLYNOMIAL  FITTING  P0&  2  VAKUbUES-P«E  ANO  TP  SC0«E*  39  OBSERVATIONS, 


TM  RATING 

THE  PREniCTOR  VARIARLE(X)  IS  PRE.  AND  THE  CRITERION  VARIABLE(Y)  IS  TP  SCORE, 

test  MEANS  ANO  STANDARD  deviations 


1  X 

0,450 

0.354 

?  SOUAR 

0.325 

0 » 2?6 

3  X  CUBE 

0.243 

0.256 

4  Y 

5.?82 

1  .990 

CORRELATION 

MATRIX 

1  X 

1.000 

0.971 

0.9U 

0.2*3 

2  SOUAR 

0.971 

1.000 

0.982 

0.281 

3  X  CUBE 

0.911 

0.982 

1,000 

0.28O 

4  Y 

0.243 

0.281 

0,28q 

1.000 

aaatisaaaaaaiaaiaaaasBisBBSiaiSBSBaaesisaaiaisisaaaaiiaaiiaialaiasBf isibsi 

FIRST.  SECOND,  ANO  THIRD  DEGREE  POLYNOMIALS. 

.  . . . . . . . . . 

MULTIPLE  R  SQUARE  ■  0.059 

MULTIPLE  R  *  0.2*3 

N.O.F.l  ai  ) 

N.O.F.2  a  37 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  ■  2*329 

BETA  WEIGHTS 
.  0.2*3 

CONTRIBUTIONS  TO  MULtlPlE  CORRELATION 

AND  REGRESSION  FacTCR  LOADINGS.  2ND  COLUMN) 

\  t  0,059  1.000 

souareo  beta  weights 

0,059 

b  weights 

1  .366 

INTERCEPT  CONSTANT  a  *.667 

as  aa»aa>isia:isiaaaiia3BaaaiBiaia»i«aH»aaai  aaaaaaaaaaaaaaaa  .aaiaian,. 

MULTIPLE  fl  SQUARE  •  0.694 

MULTIPLE  R  •  0.306 

N.O.F.l  a  2 
N.O.K.2  ■  36 

F  FOR  ANALYSIS  OF  VARIANCE  ON  R  »  1.837 

BETA  WEIGHTS 
-0,502  6 .768 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  F4CTCR  LOAOlNGSa  2ND  COLUMN) 
f  X  -0,122  0.786 

?  SOUAR  0.216  0.918 

SQUARED  seTA  WEIGHTS 
0.252  6.591 

r  weights 
-2,821  5. is* 

INTERCEPT  CONSTANT  a  4.879 

asa-BBaaaaaaaasaaaaaasaaaaaaaaaaaaascaaaaassasaaaaaaaaaaaaaaaaaBBaaaaaaaaa 

MULTIPLE  R  SQUARE  •  0.153 

MULTIPLE  R  «  0.39i 

N.O.F.l  a  3 
N.D.F.2  a  35 

f  f0r  analysis  of  variance  on  r  ■  2.112 

BETA  WEIGHTS 
-3.0B3  6,T»6  -3. STS 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

aNO  REGRESSION  FacTCR  LOaoINGSi  2N0  COLUMN) 

1  X  -0.750  0.622 

2  SOUAP  1.906  0.717 

3  X  CURE  -1.002  0.716 

SOUaRED  BETA  WEIGHTS 

9.506  *6.6**  12.73* 

B  WEIGHTS 

-17.309  *5.Sn8  -27.737 

INTERCEPT  CONSTANT  a  5,lo3 


AN()VA  TABLE  FOR  POLYNOMIALS 

aaaaaaa . . . . . . 

REDUCTION  OUE  TO  LINEAR  Fj  T»  WITH  )  OF  a  0.039 

RESIDUAL  S.S.  ■  0.9*1  OF  a  37  RESIOUaL  M.S.  1  0.625 

F  FDR  LINEAR  FIT  ■  2.329 

aaaaaaaaaaaaaaaaaaaaaBBBaBBaaaaBaaaaaataaaaaaaaaatiaaaaaaiaiMaa.aiaaaaiM 

reduction  due  to  general  quadratic  fit  with  DF  2,  a  0.094 

RFOUCTION  M.S.  ■  0.047 

RFSTOUAL  S.S.  a  0.906  OF  ■  36  RESIDUAL  M,S,  a  0.025 

E  FDR  QUADRATIC  FIT  a  1.857 

reduction  ouf  to  quadratic  term  alone»  with  i  cf»  ■  0.034 

F  FDR  QUADRATIC  term  alone  a  1.363 


REDUCTION  OUE  TQ  GENERAL  CUBIC  FIT  WITH  OF  3*  a  0.153 

REDUCTION  M.S,  a  0.051  v 

RESIDUAL  S.S.  •  0.847  OF  a  35  RESIDUAL  M,J,  a  0.024 

f  for  gfneral  cubic  fit  ■  2.112 

REDUCTION  OUF  TO  CUBIC  TERM  ALONE  WITH  1  OF  ■  0.060 

F  FDR  CUBIC  TFRM  ALONE  a  2.4/0 


■  ■iiaiiMBaaiiggiiMaiMMiiiiiiiHiiiMiiiiiiiaDKBiiiaaiMBSiHii.iiiiiuiia 

POLYNOMIAL  FITTING  FOB  2  VAHIABLES-GRE  ANO  TP  SCORE-  39  CBSERVaTIOnSb 


TM  RATING 

THE  PREOICTOB  VABIABLE(X)  IS  GREt  ANO  THE  CRITERION  VARIABLES)  IS  TP  SCORE. 


TEST  MEANS  ANO  STANOARC  DEVIATIONS 

1  X  0,871  0.173 

2  SOUAR  0.78B  0.2l0 

3  X  CUBE  0.720  0.2*5 

A  Y  5.282  1.996 

correlation  matrix 

1  X  1.O0Q  0.952  0.888  0.186 

2  SQUAR  0.952  1.000  0.986  0.170 

1  X  CUBE  0.888  0.986  1.000  0.163 

•  .A  Y  0.186  0.170  0.163  1.000 

■  ■■oaa8i3saiixacii>aaiinXiiaiiaai»ii>t>>«sas  33  iiaasaiassMaaiaiaisi  naaia 

FIRST,  SECOND,  AND  THIRD  DEGREE  POLYNOMIALS. 

aciaiaiaaBaassiaaaiiaiaaaasiaeaaiiiiaiflaaaaaasiaiimiisaiaslIiaaaiaiaaaai 

MULTIPLE  R  SOIIARE  •  0.035 

MULTIPLE  «  ■  0.186 

N.O.F.l  a  T 
N.0.F.2  ■  37 

E  FRO  ANALYSIS  OF  VARIANCE  ON  R  •  1.327 

BETA  WEIGHTS 
0,186 

CONTRIBUTIONS  TO  multiple  CORRELATION 

and  REGRESSION  FacTCR  LGaoINGS*  2ND  COLUMN) 

T  x  0.035  1.000 

SoUaREO  BETA  WEIGHTS 
0.035 

B  weights 

2.131 

INTERCEPT  CONSTANT  •  3.A26 

aaaaiaa a  aasasaa  aaa aaa  *»  SBaaaaeaBaaiaa a a  aaa  aaa aa aaa aaaa  a a  sa  aaaa aaaa aasaa 

MULTIPLE  R  SOIIARE  ■  0.035 

MULTIPLE  R  ».  0.187 

N.O.F.l  »  2 

N.0.F.2  ■  36 

F  FOR  ANALYSIS  OE  VARIANCE  ON  R  •  0b656 

BETA  weights 

0.257  -0.075 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

and  regression  factor  loaoingsi  2no  column) 

)  X  0.048  0,993 

?  SOUAR  -0,013  0.907 

SOUAREO  BETA. wEiohTS 
0,066  0.006 
B  WEIGHTS 

2.944  -0.7"4 

INTERCEPT  CONSTANT  ■  3.272 

gsaaSssaaBRBsrsasaasaaacaaiaaaasaaaaaaisasoassiaaiaaaiadaaaailaaaai •iiataa 

MULTIPLE  R  SOIIARE  ■  0.085 

MULTIPLE  R  ■  0.291 

N.O.F.l  ■  3 

N.0.E.2  ■  35 

F  FOR  ANALYSIS  OE  VARIANCE  ON  R  »  1.082 

BFT'a  WEIGHTS  . . 

3. *36  —8.987  5.971 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOaoINGS#  2N0  COLUMN) 

)  X  0.639  0.639 

.  j>  SOUAR  -1  ,529  0.584 

3  x  cuar  0.974  0.560 

SOUaREO  beta  WEIGHTS 
11.807  80.7A8  35,655 

B  WEIGHTS 

39.356  -84,877  48,463 

INTERCEPT  CONSTANT  ■  2*981 


AN<)VA  TABLE  FOR  POLYNOMIALS 

aaaaaiiaaaaaaaaBaaaBaaaaasaagsaaaaaaaaaaaaaiaj.Baiaaaaaiaaaiaa.iiiaiiaiaaa 

reduction  ouf  TO  LINEAR  FIT  a  WITH  1  OF  ■  0.035 

BESI0UAL  S.S.  ■  0.965  OF  •  37  RESIDUAL  M.s.  •  0.026 

F  FnO  LINE  AO  FIT  a  1.327 


REDUCTION  OUF  TO  GEnEBAL  GUAORATIC  FIT  WITH  OE  2a  •  0.035 

REDUCTION  M.S.  ■  0.018 

oEsIOUAL  S.s,  ■  0.965  0E  •  36  RESIDUAL  M.J,  a  0.027 

E  E OR  QUADRATIC  EIT  ■  0.656 

RFOIICTION  DUE.  TO  CUADRaTIC  TERM  ALCNC,  WITH  1  CF»  ■  0.001 

E  E0R  QUADRATIC  TERM  ALONE  a  0.020 


REDUCTION  ODE  TO  GENER4L  CUBIC  FIT  WITH  OF  3i  a  0.085 

REDUCTION  m.s,  ■  0,028 

RESIOUAL  S.S.  •  0.913  OF  ■  35  RESIDUAL  M.S.  a  0t026 

r  FOR  OENERAL  CUBIC  FIT  •  1.082 

REDUCTION  DUE  TO  CUBIC  TERN  ALONE  WITH  I  OE  ■  ,  O.OSO 

E  FOR  CUBIC  TfRM  ALONE  a  1.9fl3 


. . . . limit . . 

POLYNOMIAL  FITTING  FOR  2  VARI A01E5-WRE  ANO  TP  SCOPE-  39  OBSERVATIONS. 

TM  RATING 

Tk£  PREOICTOR  VaRIARlE(X)  IS  WHEi  AND  THE  CRITERION  VARIARLE(Y)  IS  TP  SCORE, 


TEST  MEANS  ANn  STANDaRC  DEVIATIONS 
1  X  0.496  0.194 

7  SOUAR  0.283  0»193 

3  X  CURE  0.i7<  0.1<>S 

4  Y  5 ,?02  1.906 

correlation  matrix 

1  X  1.000  0.978  0.930  0«*03 

7.  SOUAR  0.978  1.000  0.904  0.419 

3  X  CUBE  0.930  0,906  1,000  0.409 

*  .  Y  0.403  0.619  0  a  4o<9  1.000 

isa:iiai3isi3ca:8ini3>i3ai>ie8ria8iB:aa:iaii8sasi8S8iia8siisiiniiiisaml 

FIRST,  SECONp,  ANO  THIRO  DEGREE  POLYNOMIALS. 

a:a:aa:aaiiiE::c33aaaU:i:<sai9>Bii:3ini>Baaaaaiiia|aa3.amtamaaaHaaa 

MULTIPLE  R  SQUARE  »  0.162 

MULTIPLE  R  ■  0.403 

N.n.E.l  «  T 

N.O.F,?  ■  37 

E  FDR  ANALYSIS  OE  VARIANCE  ON  R  •  7.172 

BETA  WEIGHTS 
0,403 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

AND  REGRESSION  FacTCR  LOaoINGSi  2N0  COLUMNI 
T  X  0.162  1.000 

squared  beta  weights 
0.16? 

P  weights 

A. 127 

INTERCEPT  constant  ■  3*234 

aa..a3ai.s3is.:aia..g.::..ai..ig.t.i„..aaiB..ggau<i.«i..iai.i...i«i.,:t. 

MULTIPLE  R  SQUARE  «  0.1*7 

MULTIPLE  R  ■  0.4?1 

N.Q.E.l  at  7. 

N.O.E.?  >  36 

F  FOR  ANALYSIS  OF  variance  on  R  a  3*867 
beta  WEIGHTS 
•0.161  0.S76 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOAOlNGSt  2N0  COLUMN) 

T  X  *0.065  0.958 

?  SOUAR  0.242  0.997 

SQUiREO  BETA  '.'EIGHTS 
0.026  6.332 

B  WEIGHTS 
•1.644  5,9) 8 

INTERCEPT  CONSTANT  ■  4,424 

838a8a«aa«8aBr6a:R««aa83a«*8a«sa88asBi838«a8itsaisaattaaaMMiiai8aaaiaais 

MULTIPLE  R  SQUARE  »  0.224 

MULTIPLE  R  ■  0.473 

N.0.E.1  ■  3 

N.0.E.2  ■  35 

E  FOR  ANALYSIS  OF  VARIANCE  ON  R  «  3062 

BFTi  WEIGHTS 
-3.771  8 ,7a8  -4.667 

CONTRIBUTIONS  TO  MULTIPLE  CORRELATION 

ANO  REGRESSION  FacTCR  LOaoInGS.  2NO  COLUMN) 

\  *  -1.520  0.852 

7  SOUAR  3.6*0  0.886 

3  X  CUBE  *1,907  0.864 

SQUiREO  BETA  WEIGHTS 
14.222  75,033  21.785 

B  WEIGHTS 

-30.622  89.446  -56.664 

INTERCEPT  CONSTANT  ■  9,017 


ANOVA  TABLE  FOR  POLYNOMIALS 

asasaaBaiaaaaaaaaaaaeaBaaavaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaiiaaaaaaai 

REQUCTION  DUE  TO  LINEAR  FIT,  WITH  1  OF  •  0.162 

FESIOUAL  S.S.  •  0.038  OF  ai  37  RES10UAL  M.s.  «  0.023 

E  FOR  LINEAR  FIT  ■  7.172 


REDUCTION  DUF  TO  General  CUAORATU  fit  WITH  OF  2a  •  0.177 

REOUCT I  ON  M.S.  •  '  0.088 

RESIDUAL  S.S.  ■  C.P23  OF  a  36  RESIDUAL  M.S.  a  0.623 

F  FOR  QUADRATIC  FIT  •  3.867 

REOUCT I  ON  our  TO  CUaoRATIo  TERM  ALONEi  WITH  l  OFt  ■  o.ou 

E  FOR  OUAORaTTC  TERM  ALONE  ■  0.*3* 


REDUCTION  DUE  to  GENERAL  CUBIC  FIT  WITH  OF  3a  a  0,224 

RFOllCT  I  ON  M.S.  a  0.073 

RESIOUAL  S.S.  ■  0.776  OF  a  35  RESlOUAL  M.S.  •  0.022 

F  FoR  GENERAL  CUBIC  FIT  »  3.362 

REOUCT  ION  our  TO  CUBIC  TERM  ALONE  WITH  I  OF  ■  0,047 

E  FOR  CUBIC  TfRM  ALONE  a  2,113 
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JOB  TASK  CONDITIONAL  AND 
JOINT  FREQUENCIES  BY  RATING 


This  Appendix  will  be  devoted  to  presenting  the  Job  Task  Conditional 
and  Joint  Frequency  Matrices  by  rating  for  the  data  collected  on  the 
Technical  Proficiency  Checkout  Form  (TPCF).  The  matrices  are  symetric 
about  their  main  diagonal  and  therefore  only  the  upper  triangular  portion 

will  be  presented.  Denote  an  arbitrary  entry  in  the  i^  row  and  j^*1 
column  ( i = 1 ,  . ..,8)  as  a.  • ,  read  left  to  right  and  top  to  bottom  for 

■  5  J 

rows  and  columns  respectively. 

For  the  Job  Task  Conditional  Frequency  Matrices,  the  entries  on  the 
main  diagonal,  a.  .  (i=l,  ...,8),  are  the  number  of  technicians  CHECKED 

OUT  on  the  (9-i)th  job  task,  but  NOT  CHECKED  OUT  on  an  any  more  difficult 
task.  The  entry  off  the  main  diagonal,  a^  .  ( i =1 ,  ...,  8;  j>i)  is  the 

number  of  technicians  CHECKED  OUT  on  the  (9-j)^  task  given  they  are 

CHECKED  OUT  at  most  on  the  (9-i;  task.  For  example,  from  page  J-4,  there 
were  17  EM's  who  were  CHECKED  OUT  at  most  on  Job  Task  No.  7,  i.e.,  they 
were  NOT  CHECKED  OUT  on  Job  Task  No.  8.  Of  those  17  men  4,  13,  14,  17, 

17,  and  17  were  CHECKED  OUT  on  Job  Task  No.'s  6,  5,  4,  3,  2,  and  1  res, 
pecti vely. 

In  the  Job  Task  Joint  Frequency  Matrices,  the  entries  on  the  main 
diagonal,  a.  .  (i=l,  ...,  8),  are  the  number  of  individuals  CHECKED  OUT 
th  1,1 

on  the  i  task,  regardless  of  their  performance  on  any  of  the  other  tasks. 
The  entries  off  the  main  diagonal,  a-  .  (i=l,  ...,  8;  j>i),  are  the  number 

1  »J  th  th 

of  technicians  CHECKED  OUT  on  both  the  i  and  j  job  task.  For  example, 
from  page  J-4,  75  EM's  were  CHECKED  OUT  on  Job- Task  No.  5,  42  on  Job  Tasks 
No. ' s  5  and  6,  etc. 
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ELECTRICIAN'S  MATE  (EM)  RATING 
(N  =  97) 


Conditional  Frequencies 


A  7  6 

65  4ft  33 

17  4 

6 


Job  Task 


5 

4 

3 

2 

1 

50 

50 

50 

52 

55 

13 

14 

17 

17 

17 

6 

5 

5 

4 

6 

6 

5 

6 

6 

6 

3 

3 

3 

3 

6 

5 

6 

o  o 

2 


The  number  of  technicians  not  CHECKED  OUT  on  any  job  task  is  2 


Joint  Frequencies 


Job  Task 


1 

2 

3 

4 

5 

6 

7 

8 

96 

87 

87 

77 

75 

43 

63 

55 

87 

84 

.  73 

70 

40 

63 

52 

87 

71 

69 

40 

62 

50 

77 

69 

40 

56 

50 

75 

4? 

56 

50 

43  35  33 

63  46 

55 
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ELECTRONICS  TECHNICIAN  (ET)  RATING 
(N  =  173) 


Conditional  Frequencies 


Job  Task 


8 

7 

6 

5 

4 

3 

2 

1 

13? 

114 

PI 

113 

131 

127 

123 

131 

IS 

5 

6 

15 

15 

1 1 

15 

10 

S 

6 

10 

7 

9 

2 

2 

2 

1 

2 

9 

8 

4 

8 

?  1  1 

o  o 

2 

The  number  of  technicians  not  CHECKED  OUT  on  any  job  task  is  1 


Joint  Frequencies 
Job  Task 


1 

2 

3 

4 

188 

148 

180 

163 

147 

146 

143 

164 

159 

165 

J- 


5 

6 

7 

8 

126 

95 

129 

131 

117 

89 

118 

123 

124 

95 

124 

127 

125 

94 

129 

131 

126 

88 

108 

113 

96 

83 

81 

129 

114 

132 

FIRE  CONTROL  TECHNICIAN  (FT)  RATING 
(N  =  154) 


Conditional  Frequencies 


8  7 

6 

Job 

5 

Task 

4 

3 

2 

i 

10?  92 

74 

88 

101 

94 

90 

102 

8 

8 

8 

8 

8 

8 

8 

14 

Q 

1? 

14 

12 

14 

15 

14 

1? 

10 

14 

8 

4 

4 

7 

2 

1 

2 

0 

0 

The  number 

of  technicians 

not 

CHECKED 

OUT  on  any  job 

task  is 

1 

4 

Joint  Frequencies 


Job  Task 


l 

2 

3 

4 

148 

125 

134 

1  4  1 

125 

124 

121 

134 

128 

143 

5 

6 

7 

8 

115 

93 

100 

1  02 

101 

86 

94 

90 

108 

91 

96 

94 

114 

90 

99 

101 

116 

76 

86 

86 

93 

76 

74 

100 

92 

102 
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INTERIOR  COMMUNICATIONS  ELECTRICIAN  (IC)  RATING 

(N  =  58) 


Conditional  Frequencies 
Job  Task 

*  7  6  5  4  3  2  1 

27  27  20  23  27  26  26  27 

6  1  6  5  6  6  6 

5  4  2  4  4  5 

8  7  6  4  8 

3  3  2  3 

4  3  4 

0  0 
4 

The  number  of  technicians  not  CHECKED  OUT  on  any  job  task  is  1 


Joint  Frequencies 
Job  Task 


1 

2 

3 

4 

57 

45 

49 

44 

45 

45 

38 

49 

41 

44 

5 

6 

7 

8 

41 

26 

33 

27 

36 

25 

32 

26 

38 

25 

32 

26 

37 

23 

32 

27 

41 

25 

29 

23 

26 

21 

20 

33 

27 

27 
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RADARMAN  (RD)  RATING 
(N  =  139) 


Conditional  Frequencies 


?. 


136 


Job 

Task 

7 

6 

5 

4 

3 

2 

1 

7 

6 

25 

14 

4 

5 

26 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

0 

0 

1 

70 

31 

30 

16 

70 

3 

2 

2 

3 

1 

1 

1 

2 

2 

32 

number 

of  technicians  not 

CHECKED  OUT 

on 

any  job  task 

is  3 

Joint  Frequencies 

Job 

Task 

2 

3 

4 

5 

6 

7 

8 

27 

38 

50 

97 

a 

8 

26 

27 

23 

ie 

21 

3 

1 

5 

3b 

23 

34 

2 

2 

4 

50 

47 

7 

6 

14 

97 

8 

8 

25 

8 

3 

6 

7 

26 
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RADIOMAN  (RM)  RATING 
(N  =  137) 


Conditional  Frequencies 
Job  Task 


P  7 

6 

5 

4 

3 

2 

l 

13  in 

9 

13 

13 

13 

12 

13 

17 

8 

17 

17 

11 

li 

17 

29 

28 

22 

28 

24 

29 

55 

32 

40 

34 

55 

4 

3 

3 

4 

5 

4 

5 

0 

0 

The  number 

of  technicians 

not 

CHECKED  OUT 

on  any  job 

task  is 

12 

2 

Joint 

Frequencies 

Job  Task 

l 

2 

3 

4 

5 

h 

7 

8 

135 

PR 

100 

88 

113 

46 

27 

13 

88 

88 

89 

81 

36 

20 

12 

loo 

76 

91 

40 

21 

13 

88 

83 

39 

27 

13 

113 

45 

27 

13 

46 

17 

9 

27  10 

13 
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SONAR  TECHNICIAN  (ST)  RATING 
(N  =  152) 


Conditional  Frequencies 
Job  Task 


«  7 

6 

5 

4 

3 

2 

l 

BO  64 

74 

69 

78 

77 

77 

80 

1,3 

u 

9 

12 

13 

13 

13 

18 

16 

10 

15 

14 

18 

27 

15 

10 

10 

24 

2 

1 

1 

2 

3 

3 

3 

0 

0 

The  number 

of  technicians 

not 

CHECKED  OUT 

on  any  job 

task  is 

4 

5 

Joint  Frequencies 

Job 

Task 

1 

2 

3 

4 

5 

6 

7 

8 

144 

118 

119 

115 

118 

103 

77 

80 

118 

118 

102 

99 

98 

76 

77 

119 

102 

100 

99 

76 

77 

117 

101 

94 

76 

78 

121 

92 

69 

69 

103 

75 

74 

77 

64 

80 
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TORPEDOMAN'S  MATE  (TM)  RATING 
(N  =  39) 


Conditional  Frequencies 
Job  Task 


6  7 

6 

5 

4 

3 

2 

l 

8  ft 

ft 

8 

8 

8 

8 

8 

12 

5 

12 

11 

12 

12 

12 

.  3 

3 

3 

3 

3 

3 

11 

4 

6 

6 

10 

5 

3 

2 

5 
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0 

0 

0 

0 

The  number 

of  technicians 

not 

CHECKED  OUT 

on  any  job 

task 

0 

is  0 

Joint  Frequencies 

Job  Task 

1 

2 

3 

4  5 

6 

7 

8 

38 

30 

31 

31  33 

1* 

18 

8 

31 

31 

27  29 

14 

18 

8 

3? 

28  29 

14 

18 

8 

31  26 

14 

17 

8 

34 

14 

18 

8 

14 

10 

6 

16  6 
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THE  UTILITY  OF  THE  WRE 


The  purpose  of  this  section  is  to  demonstrate  the  utility  of  the  WRE 
as  an  estimator  of  individual  performance.  Essentially  it  is  a  useful  type 
of  estimator  in  that  it  is  not  dependent  on  a  convention  to  be  adopted  for 
the  case  wherein  a  man  did  not  work  at  particular  job  activity.  As  such 
the  convention  need  only  provide  reliability  ratios  for  those  job  activities 
for  which  the  man  being  evaluated  received  SUE  =  0  and  ZU I  =  0  from  his 
supervisor. 

Each  square  in  Table  1  represents  a  breakdov/n  of  Table  E-l  into  the 
number  (and  proportion)  of  men  who  did  not  work  at  a  particular  job  acti¬ 
vity  and  those  men  who  received  IUE  =  0  and  IUI  =  0.  For  example,  on  job 
activity  Number  1,  19  (19.6%  of  the  EM's)  received  EUE  =  0  and  ZUI  =  0 
and  6  (6.2%  of  the  EM's)  did  not  work  at  that  job  activity.  The  composite 
reliability  values  need  then  only  be  employed  on  19.6%  of  the  men  in  that 
rating  and  job  activity  rather  then  on  25%  of  the  men  as  required  by  the 
SRE,  PRE,  and  GRE.  More  significantly!  in  the  case  of  RD's  and  RM's,  for 
example,  at  most  59%  (as  compared  to  99%  for  the  SRE,  PRE,  and  GRE)  of  the 
men  in  those  ratings  derive  reliability  ratios  for  some  job  activities 
from  the  composite  reliability  table.  Clearly  this  is  a  significant  im¬ 
provement  which  should  improve  individual  performance  estimates.  The 
statistical  analyses  reported  in  the  main  text  of  this  oaoer  verified  this 
conjecture . 

Derivation  of  the  Weights  Employed  by  the  WRE 

On  the  JPQ  ANSWER  SHEET  is  Appendix  A,  page  A-4 ,  in  column  (c)  for 
each  job  activity  the  following  question  was  answered  by  the  supervisor 
on  the  man  he  was  evaluating: 

QUESTION  (c)  Considering  this  man's  overall  performance.,  it  is  your 
opinion  that  the  importance  of  this  job  activity,  as  a 
factor  in  determining  the  overall  performance  of  this  man, 
is  best  described  as  being: 

3.  of  central  and  primary  importance 
2.  a  significant  factor,  but  of  secondary  importance 
1.  of  only  moderate  importance  in  estimating  overall 
performance 

0.  of  little  or  no  importance 

The  weights  (w^)  for  the  i*-*1  job  activity  are  determined  by  the  formula 
If  the  supervisor  recorded  the  i^*1  job  activity  as: 
of  central  and  primary  importance,  the  weight  w  •  =  1.0 
of  secondary  importance,  the  weight  w^  =  .75 
of  moderate  importance,  the  weight  =  .5 
of  little  or  no  importance,  the  weight  wn-  =  .25. 
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TABLE  K-l 


NUMBER  AMD  PROPORTION  OF  TECHNICIANS  IN  EACH  PROBLEM  AREA 

Job 

Act. 

1 

2 

3 

4 

5 

6 

7 

8 

Number  of  Men  Each  Rating 

97  173  154  58  139  137  152  39 

NZ  =  Number  and  Proportion  of  Technicians  Who  Received  IUE=0  and  IUI=0 

NW  =  Number  and  Proportion  of  Technicians  Who  Did  Not  Work  at  that  Job  Activity 

K-4 


Rating 


EM 

NZ  MW 

ET 

NZ  NW 

FT 

NZ 

NW 

IC 

NZ  MW 

RD 

NZ  NW 

PM 

NZ 

NW 

ST 

NZ 

MW 

TM 

NZ  NW 

19 

6 

38 

0 

51 

9 

9 

0 

46 

4 

34 

19 

39 

6 

6 

0 

0,196 

0,062 

0,220  0,000 

0,331 

0,032 

0,159 

0 ,000 

0,331 

0,029 

6,248 

0,139 

0,257 

0,039 

0,154 

o .  noo 

16 

7 

47 

0 

48 

1 

7 

0 

52 

1 

27 

15 

36 

9 

13 

0 

0,169 

0,072 

0,272  0,000 

0,312 

0.006 

0,121 

0,  000 

0,374 

0,007 

6.197 

0,109 

0,237 

0,059 

0,333 

o.ooo 

ZB 

1< 

42 

3 

70 

5 

17 

1 

7i 

62 

47 

57 

53 

16 

20 

6 

0,289 

0,144 

0.243  0 , Ol7 

0,455 

0,032 

o;29S 

0.017 

0,911 

0,446 

0.343 

0,416 

0,349 

0,105 

0,513 

0.154 

29 

1* 

53 

30 

67 

26 

22 

5 

50 

25 

39 

38 

57 

19 

8 

2 

0,299 

0,144 

0,306  0,173 

0,435 

0,169 

0i379 

0,066 

0,360 

0,160 

0,289 

0,277 

0,375 

0,125 

0,205 

0.051 

.16 

5 

82 

1 

79 

1 

7 

0 

7£ 

9 

39 

11 

SB 

4 

10 

1 

0,186 

0,052 

0.474  0,006 

0,913 

0,006 

0,121 

0 , 000 

0,911 

0,036 

0,289 

0,080 

0,362 

0,026 

0,256 

0.026 

28 

B3 

33 

79 

36 

24 

11 

59 

41 

42 

46 

58 

32 

15 

5 

0,392 

0,124 

0,480  0,191 

0,913 

0,234 

0;414 

0.190 

0,424 

0,295 

0 , 307 

0,336 

0,382 

0,211 

0,389 

0.128 

13 

5 

47 

1 

69 

14 

5 

0 

50 

87 

54 

74 

49 

27 

23 

2 

0.134 

0,052 

0,272  0,006 

0,448 

0,091 

01086 

o.oon 

0,367 

0,626 

0.394 

0,940 

0,322 

0,178 

0,590 

0.051 

22 

13 

48 

0 

60 

4 

12 

0 

51 

si 

50 

64 

49 

16 

18 

4 

0,227 

0,134 

0,277  0,000 

0,390 

0,026 

0,207 

0,000 

0,367 

0,583 

0.369 

0,467 

0,296 

0,105' 

0,462 

0.103 
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